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ABSTBACT 


The  rapid  growth  of  information  systems  technology  has 
created  new  challenges  for  the  inforaati on/computer  center 
management.  Major  investments  in  computer  hardware  and 
software  and  expansion  of  the  data  processing  roles  in  many 
organizations  has  had  profound  effects  on  the  management  of 
those  organizations.  A  management  control  system  must  be 
used  tc  1)  provide  communication  between  the  user  and  the 
data  processing  activity  to  act  in  the  best  interests  of  the 
organization,  2)  encourage  effective  and  efficient  use  of 
the  information  resource  and  3)  provide  information  relevent 
to  future  investment  decisions.  Each  crganiza+ion  has 
specific  organizational  objectives  that  change  over  time  and 
therefore  requires  a  control  system  mechanism  that  must  be 
sufficiently  flexible  to  continue  to  meet  those  objectives. 

This  thesis  provides  a  managerial  guide  by  which  a 
computing  facility  manager  can  implement  a  management 
control  system  or  evaluate  an  existing  system. 
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I.  IHTBODOCTION 


1.  BCIB  Of  HAHAGEHE1T  COST  BOL  STSTESS 

A  management  control  system  is  a  critical  network  which 
integrates  the  orgarizati on' s  operations  [Ref.  1  ].  It 
focuses  cn  guiding  the  organization  on  a  year-to-year  tasis 
but  dees  so  in  such  a  way  as  to  be  consistent  with  the 
lcng-iange  organizational  strategy.  A  "management  control 
systen  builds  on  the  output  of  the  planning  process  to 
develop  a  portfolio  of  projects,  hardware/software  enhance¬ 
ments  and  additions,  facilities  plans,  and  staffing  levels 
for  the  year”  [Bef.  2]-  The  management  control  system  moni¬ 
tors  the  progress  of  these  developments  and  alerts  appro¬ 
priate  levels  of  the  organization  when  performance  deviates 
from  the  expected  standards.  Control  systems  for  a  Navy 
computing  facility  should  be  adapted  to  a  very  different 
software  and  operations  technology  in  the  1980's  than  was 
present  in  the  197C's  [Ref.  3}.  The  management  control 
system  must  take  into  account  the  sophistication  of  the 
users,  geographic  dispersion  of  the  organization,  stability 
cf  management,  the  organization's  structure,  and  the 
interdepartmental  relationships  [Ref.  4],  The  significance 
cf  the  computing  facility  in  the  overall  organizational 
strategy  is  an  important  consideration  in  how  tightly  the 
management  control  system  should  be  maintained. 

Bithin  the  Navy,  computer  centers  are  operated  as  inde¬ 
pendent  service  organizations.  They  provide  services  to 
"client"  organizations,  as  in  the  case  of  a  Naval  Automated 
Regional  Data  Center  (NARDAC)  supporting  the  inventory  func¬ 
tions  cf  a  Naval  Air  Rework  Facility  (NARF)  or  as  a  data 
processing  center  within  a  Navy  Supply  Center  organization 


8 


supporting  the  functions  of  other  departments  at  that  Supply 
Center.  Traditional  management  control  models  have  stressed 
the  financial  control  architecture,  the  financial  control 
process  and  the  audit  function.  In  an  operational  sense  the 
non-f inancial  management  control  system  is  just  as  important 
in  the  day-to-day  management  of  the  data  processing  center. 
The  ccmputer  center  manager  must  survey  the  user  community 
to  determine  the  adequacy  of  data  processing  support  being 
provided,  the  status  of  user  service  agreements,  and  fore¬ 
casts  of  user  requirements  for  long-range  system  acquisition 
and  utilization  planning. 

The  control  system  provides  data  on  the  status  of  the 
organization's  operations.  It  is  a  means,  not  an  end  in 
itself.  The  control  system  "helps  the  organization  meet  its 
objectives,  not  find  wrongdoers"  [Ref.  5],  Additionally, 
the  computer  center  manager  must  be  concerned  not  only  with 
"controlling  data  center  activities  so  that  performance 
standards  are  met,  but  also  how  procedures  and  technology 
can  be  modified  to  permit  the  setting  cf  higher  performance 
standards"  [Ref.  6].  According  to  Schaeffer,  computer 
center  managers  have  three  tools  that  have  proved  successful 
in  controlling  data  center  activities:  "  the  receipt  of 
management  reports,  the  existence  of  an  active  data  center 
steering  committee,  and  availability  of  a  user/data  center 
handbook"  [Ref.  7].  These  three  tools  can  be  used  to 
provide  managers  with  critical  information  on  which  to  base 
reasonable  decisions,  provide  a  channel  of  communication 
between  the  data  center  and  user  representatives  and  provide 
explicit  documentation  on  the-  functional  organization  and 
operating  procedures  cf  the  data  center  [Ref.  8]. 

Organizations  differ  in  their  abilities  to  measure 
either  output  or  behavior  which  is  relevant  to  a  desired 
perfcmance.  Ouchi  [Ref.  9]  describes  three  fundamentally 
different  mechanisms  through  which  organizations  manage  this 


problem  cf  evaluation  and  control.  The  three  frameworks  fir 
well  into  the  schemes  for  control  systems  that  must  ba 
developed  for  computer  facilities.  The  three  frameworks 
Cuchi  describes  are  called  markets,  bureaucracies,  and 
clans.  "The  problem  of  organization  is  the  problem  of 
obtaining  cooperation  among  a  collection  of  individuals  or 
units  who  share  only  partially  congruent  objectives" 
(Ref.  10].  The  frameworks  determine  the  type  of  control 
process  which  effectively  eliminates  the  goal  incongruence 
and  is  defined  by  the  different  characteristics  cf  behavior, 
output  or  process  measurement  within  each  framework. 
Fundamentally,  in  a  market  the  control  problem  is  managed  by 
its  ability  to  precisely  measure  outputs;  bureaucracies  rely 
upon  the  measurement  cf  the  process;  and  clans  use  a  social¬ 
ization  process  which  uses  cultural  influences  to  guide 
behavior  towards  congruent  goals  because  of  an  inability  to 
obtain  quantifiable  measurements.  Of  course,  in  reality  a 
pure  market,  bureaucracy  or  clan  would  not  exist.  "Real 
organizations  will  each  contain  some  features  of  each  of  the 
modes  cf  control"  [Ref.  11].  The  design  problem  thus 
becomes  cne  of  assessing  t be  characteristics  of  measurement 
and  determining  the  proper  form  of  control  [Ref.  12]. 

Indeed,  the  ability  to  measure  either  output,  or  process 
which  is  relevent  to  the  desired  performance  is  a  key  issue 
in  determining  the  proper  form  of  control.  The  basic  and 
fundamental  assumption  underlying  any  bureaucratic  or  market 
form  cf  control  is  the  assumption  that  it  is,  in  fact, 
feasible  tc  measure  with  reasonable  accuracy  the  performance 
which  is  desired  [  Bef .  13].  A  control  system  based  on 
ambiguous  and  inappropriate  measurements  is  likely  to  be 
ineff  ,tive  and  under  such  conditions,  the  clan  form  of 
control,  which  stresses  values,  educational  background,  and 
behavior  may  well  be  preferable. 
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Two  key  issues,  therefore,  in  design  of  a  management 
control  system  for  a  computer  facility  are  the  clarity  with 
which  performance  car.  be  assessed  and  the  degree  of  goal 
congruence.  These  two  dimensions  are  stated  by  Ouchi  to  be 
"intimately  related  ir.  determining  forms  of  control.”  The 
problem  for  the  manager  when  designing  a  control  system  is 
to  discover  the  balance  of  socialization  and  measurement 
which  most  effectively  promotes  goal  congruency. 

Summarizing,  the  role  of  management  control  in  an  orga¬ 
nization  is  to  assist  management  in  the  planning,  coordina¬ 
tion  and  control  cf  the  organization's  responsibility 
centers  where  "  a  responsibility  center  is  a  group  of  people 
headed  by  a  manager  who  is  responsible  for  what  it  is  doing” 
[Ref.  14]. 

E.  CONTROL  STSTEH  PBGBLEHS  FACING  INFORMATION  MANAGERS 
1 •  Information  Exclosi cn 

A  major  stimulant  to  information  system  growth  is 
the  emergence  of  groups  cf  experienced  computer  systems 
users.  As  the  users  become  familiar  with  the  capabilities 
cf  information  and  data  processing  centers,  they  generate 
additional  data  processing  requirements.  If  an  effective 
control  system  is  net  in  place  to  appraise  the  potential 
costs  and  benefits  of  new  requirements  the  organization  may 
experience  ”  explosive  gro wth . . . with  new  capacity  required 
every  one  cr  two  years”  [Ref.  15].  There  must  be  a  balance 
between  innovation  and  control.  The  management  of  the  data 
processing  center  and  the  user  management  must  clearly 
understand  and  agree  to  the  policies  of  control. 

The  control  system  must  deal  with  capacity  expansion 
in  a  manner  that  is  consistent  with  both  data  center  and 
user  management  objectives.  Complex  trade-offs  exist  in  the 
areas  cf  capacity  utilization  emerging  from  the  Nolan  phases 


cf  "initiation,  contagion,  control  and  integration”  and  user 
innovation.  In  a  situation  where  congruent  management  goals 
encourage  user  exposure  and  interest  in  new  adaptations  and 
applications,  the  control  system  significantly  differs  from 
the  situation  where  user  applications  are  nearing  the 
capacity  saturation  point  and  the  management  goal  is 
controlling  a  scarce  resource.  The  trade-offs  made  in  inno¬ 
vation,  with  its  accompanying  risks  and  payoff  opportuni¬ 
ties,  versus  conservatism  and  the  inherent  reliability,  must 
te  reflected  in  the  type  of  management  objectives  involved 
and  the  emergent  control  system  [Ref.  16].  Organizations 
which  stand  to  benefit  either  from  significant  cost  reduc¬ 
tions  cr  process  efficiencies  or  competitive  technological 
advantages  should  adopt  control  systems  that  allow  and 
encourage  mere  innovation  than  one  that  has  a  great  deal  of 
dependence  cn  a  smooth,  reliable  operation. 

The  control  system  must  be  responsive  to  the  user's 
short-term  requirements  but  net  at  the  expense  of  the  data 
processing  center's  orderly  development  and  execution  of  the 
long-range  planning  inherent  in  the  computer  resource  life- 
cycle.  The  management  control  system  should  be  a  tocl  to 
set  an  equilibrium  between  the  user  requirements  and  data 
processing  center's  plans  and,  at  the  same  time,  ensure  that 
the  operations  support  the  overall  organizational  objec¬ 
tives.  The  control  system  must  also  not  be  overly  cumber¬ 
some  cr  restrictive  or  users  will  be  encouraged  to  seek 
alternative  or  multiple  sources  of  computer  services. 

According  to  Schaeffer  [Ref.  17]  an  excellent 
channel  for  bringing  together  data  center  and  user  depart¬ 
ment  representi ves  is  the  data  center  steering  committee. 
This  can  he  a  mechanism  fer  festering  rapport  and  mutual 
assistance  between  the  users  and  data  processing  organiza¬ 
tions.  The  activities  of  the  committee  should  include: 
"coordination  of  data  center  and  user  activities,  resolution 
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cf  scheduling  difficulties,  data  center  management's  aware¬ 
ness  cf  upcoming  resource  demands,  user  awareness  of  appli¬ 
cation  processing  problems  and  inefficiencies,  and  review  of 
alternative  processing  approaches"  [Ref.  18],  Additional 
issues  tc  be  addressed  are:  status  of  user  service  agree¬ 
ments,  user  service  profile  trends,  and  user  involvement  in 
application  program  development.  The  user  functional  domain 
and  the  data  processing  center's  functional  domain  must  be 
clearly  set  and  agreed  upon  so  control  systems  can  be 
specifically  designed  and  modified  to  support  the  long-term 
erg  a  r.i  rational  strategies  and  near-term  emergent  require¬ 
ments.  Control  of  new  requirements  and  new  technology  must 
be  a  major  facet  of  a  management  control  system.  The 

management  control  system  must  balance  innovation  and 
control  cf  the  computer  resources  in  a  way  that  is  sensitive 
to  changing  demands  cf  the  users  and  provide  a  framework  for 
efficient  and  effective  resource  utilization. 

2 •  Software  Development 

The  recent  shift  in  the  corporate  world  to  purchased 
software  instead  of  in-house  construction  is  a  primary 
concern  for  the  data  processing  center.  The  proliferation 
cf  user  microcomputers  or  minicomputers  poses  some  real 
problems  fer  the  data  processing  manager  in  terms  of 
construction  of  new  software,  integration  of  in-house  soft¬ 
ware  with  standard  user-oriented,  purchased  software  and 
maintenance  of  both  existing  and  newly  purchased  software. 
The  supply  cf  cheap  commercial  software  is  growing  dramati¬ 
cally  and  many  vendors  offer  various  standard  software  pack¬ 
ages,  such  as  payroll  and  accounting,  as  well  as  report 
generators  and  procedural  languages.  The  problem  is  partic¬ 
ularly  critical  when  the  user  has  authority  to  buy  and 
operate  commercially  available  software  while  the  data 
processing  center  still  has  responsibility  for  maintenance 
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cf  ether  services  and  ensuring  compatibility  of  the  commer¬ 
cial  software  with  existing  software.  The  data  processing 
nanager  must  deal  with  problems  of  span  of  control#  central¬ 
ization  versus  decentralization  of  the  computing  resource# 
effective  resource  utilization  in  terms  of  mainframe  utili¬ 
zation  and  duplication  of  applications#  and  costs  associated 
with  less  of  economies  of  scale  in  processing  and  storage. 
Cash  [Ref.  19]  identifies  the  following  key  issues  for  the 
data  processing  manager  in  loss  of  "operations  monopoly 
control" : 

a)  "  How  to  maintain  existing  services  while  building 
appropriate  and  necessary  data  bridges  to  the  new 
ones. " 

b)  "  Hew  to  evolve  the  IS  operations  organization  from  a 

primary  integrated  system  of  data  processing  to  a 

series  of  services  which  are  better  focused  on  the 

specific  needs  cf  different  users." 

c)  "  How  to  develop  user  understanding  of  both  their  real 
operational  responsibility  over  the  systems  under 
their  control  and  how  to  interface  effectively  with 
the  (data  processing  center)." 

Hith  these  control  issues  in  mind#  the  data  center  manager 
may  want  to  consider  a  requirement  that  certain  life-cycle 
management  techniques#  such  as  including  software  mainte¬ 
nance  costs#  be  used  when  the  user  will  be  acquiring  hard¬ 
ware  or  software  for  which  the  data  center  will  continue  to 

have  maintenance  responsibility.  A  benefit  of  the  life- 
cycle  management  approach  is  that  it  will  recommend  a  cost- 
benefit  analysis  for  acquisition  of  new  hardware  and 
software  that  can  be  compared  to  the  cost  of  the  application 
run  by  the  data  processing  center’s  mainframe.  This  life- 
cycle  approach  will  help  managers  decide  whether  tc  imple¬ 
ment  a  near-term  fix  by  buying  new  software  or  hardware  or 
take  a  lcnger-rar.ge,  broader  scope  solution  where  the  new 


application  can  be  integrated  into  the  present  data 

processing  system. 

Another  management  consideration  that  must  be 
addressed  if  the  users  do  acquire  other  computing  services 
cr  software  is  that  all  computers  and  "  of f ice-of-the- 
future"  products  are  candidates  for  interconnection  to  a 
variety  cf  other  machines  [Ref.  20].  The  movement  toward 
networks  and  distributed  data  systems  will  require  that  the 
user's  hardware  and  software  be  compatible  with  a  data-base 
management  system  needed  tc  operate  with  distributed  data 
bases.  The  long-range  planning  involved  for  software  devel¬ 
opment  is  therefore  net  a  trivial  matter.  Software  develop¬ 
ment  decisions  must  be  an  integral  part  of  the  data 
processing  management  strategy.  The  decision  to  buy  off- 
the-shelf  software  for  a  user  function  may  seem  a  relatively 
small  decision  to  make  now,  but  it  can  have  a  significant 
impact  cn  the  user  and  data  processing  center's  interface 
and  management  relationship  in  the  future.  The  management 
control  system  must  therefore  address  controls  on  the  devel¬ 
opment  cr  purchase  of  new  software. 

The  management  control  system  must  also  monitor  the 
extent  cf  software  maintenance  as  well  as  the  resources  used 
and  costs  associated  with  the  maintenance.  Theoretically, 
the  maintenance  costs  could  exceed  the  cost  of  a  new  soft¬ 
ware  system  but  the  data  processing  manager  would  not  know 
this  unless  he  had  some  measure  of  performance  of  the 
existing  software  system.  Seme  measures  that  can  be  used 
are  the  direct  labor  costs  (programming) ,  down-time  associ¬ 
ated  with  software  maintenance,  and  computing  capacity 
utilized  fer  implementation  of  the  new  cr  modified  software. 

3 .  Costing 


The  costs  associated  with  operating  a  data 
processing  center  include  much  more  than  the  costs  attrib- 
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uted  to  the  conputer  hardware.  "Today,  it  is  net  uncommon 
for  the  hardware  costs  to  account  for  less  than  20  percent 
of  the  fetal  data  processing  costs"  (Bef.  21].  Seas  of  the 
categories  of  costs  illustrated  in  figure  1.  1  are  suggested 
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A  key  issue  facing  the  data  processing  center 
manager  is  hcv  to  measure  and  allocate  costs  in  such  a  way 
as  to  encourage  effective  use  of  the  computer  center 
resources.  Cost  behavior  has  been  greatly  influenced  by 
emerging  computer  technologies,  shortage  of  trained  computer 
specialists  [Bef.  23]  and  the  aforementioned  "information 
explosion".  Por  example,  technical  advancements  have  gener¬ 
ated  replacement  hardware  with  4  to  10  times  [Ref.  24]  more 
capacity  than  existing  ones  with  costs  less  than  the  orig¬ 
inal  equipment's  purchase  price.  In  a  chargeback  environ¬ 
ment  the  data  center  manager  must  decide  whether  to  spread 
all  of  the  present  costs  on  to  their  current  users  or  fore¬ 
cast  future  costs  and  set  a  multi-year  average  which  would 
recover  costs  at  the  end  of  the  period.  If  the  manager 
chooses  to  cover  expenses  from  the  start,  higher  prices  (per 
unit  of  information)  may  inhibit  user  innovation  and  appli¬ 
cation  experimentation.  On  the  other  hand,  a  multi-year 
average  cost  decision  could  encourage  (by  lower  prices)  mere 
capacity  useage  and  spark  new  application  development. 

The  effect  cf  cost  allocation  is  not  a  trivial 
matter  in  a  chargeback  enviroment.  where  users  are  charged 
for  computer  services,  either  by  chargeback  or  reimturse- 
ables,  costs  allocation  has  a  significant  impact  on  the  type 
and  guantity  of  services  requested  and  future  application 
development  requests.  Users  are  motivated  "to  be  concerned 
about  the  value  of  services  they  receive  and  managers  are 
motivated  tc  be  concerned  about  the  costs  and  quantity  of 
services  they  provide"  [Bef.  25]. 

In  a  "service  center"  situation,  costs  are  normally 
accumulated  in  the  data  processing  center  budget  and  the 
costs  are  allocated  indirectly,  not  on  the  basis  of  service 
to  the  users.  When  the  data  processing  is  offered  to  users 
basically  "  free  of  charge"  the  manager  must  deal  with 
uncontrolled  growth  cf  new  applications,  system  saturation. 


inefficient  programs,  poor  or  non-existent  job  prioritiza¬ 
tion  and  little  or  nc  controls  for  efficient  and  effective 
resource  utilization.  The  advantages  of  this  costing  scheme 
is  simplicity,  lower  accounting  costs,  and  increased  user 
experimentation  [fief.  26]. 

u.  Planning  and  Eudget ing 

The  computer  center  manager  has  a  complex  problem  in 
planning  and  budgeting.  As  will  be  discussed  later  the  data 
center  manager  must  reconcile  the  plans,  formulate  and 
execute  the  budget  and  develop  audit  techniques  to  support 
the  organizational  goals.  In  a  chargeback  accounting 
scheme,  the  budget  must  identify  those  items  that  will  be 
"mission  budgeted"  as  overhead  and  those  costs  that  will  be 
charged-back  to  the  users.  "  A  budget  is  a  quantitative 
expression  cf  a  plan  "  states  Leonard  I.  Krauss  [Hef.  27]. 
It  is  an  opportunity  to  emphasize  effectiveness  in  terms  of 
production  and  costs  and  an  opportunity  to  implement  new 
ideas  created  by  a  lcng-range  plan.  A  budget  mandates  that 
management  think  ahead  and  plan  responsibibly .  The  transla¬ 
tion  of  the  plans  into  a  budget  provide  a  suitable  framework 
for  developing  management  controls  and  evaluating  financial 
performance.  The  manager  must  translate  the  plans  into 
terms  that  correspond  to  the  centers  of  responsibility  than 
are  charged  with  executing  that  portion  of  the  plan.  This 
translation  is  a  statement  of  the  outputs  expected  during 
the  budget  year  and  the  resources  to  be  used  in  achieving 
these  outputs.  The  melding  of  organizational  plans  into  the 
budget  also  provides  a  mechanism  for  coordination  cf  effort 
and  resources  and  consolidation  of  resource  requirements  to 
be  mere  effective  in  resource  assignment. 

The  data  prccessing  manager  has  to  consider  the 
following  things  in  preparing  a  budget: 

a)  User  demand  and  resource  supply  for  computer  services. 
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b)  The  effect  on  ••sales”  of  service  pricing,  quality  and 
responsiveness , 

c)  The  effect  of  commercial  competition, 

d)  He*  to  generate  new  users. 

Eecause  accurate  and  reliable  cost  estimates  are  needed  for 
an  effective  budget,  the  data  center  manager  must  receive 
inputs  from  the  users  on  the  volume,  type,  quantity,  etc.  of 
services  that  will  be  requested  of  the  computer  center. 
These  inputs  must  be  incorporated  in  a  functional  categor¬ 
ization  cf  the  data  processing  budget.  The  data  processing 
manager  must  forecast  the  user's  demand  based  cn  variable 
prices  and  develop  budgetary  controls  to  monitor  the  confor¬ 
mance  to  the  financial  constraints. 

5 .  Auditing 

There  is  a  significant  relationship  between  the  data 
processing  department  and  the  audit  process.  This  relation¬ 
ship  affects  the  data  processing  "stability,  effectiveness, 
and  even  its  survival"  [Hef.  28].  Audits  can  come  in  two 
forms:  (1)  external  or  (2)  internal  and  with  two  points  of 

view;  (1)  financial  or  (2)  data  processing  management  and 
operational  functions. 

The  external  audit  is  normally  done  by  personnel 
outside  the  organization  hired  as  an  objective  source  tc 
comment  and  verify  the  organization's  financial  posture. 
Although  not  always  trained  or  experienced  in  data 
processing,  external  auditors  will  be  interested  in  the 
following  areas:  [Hef.  29] 

a)  The  authenticity  of  computer-generated  financial  data. 

b)  The  control  and  security  of  data. 

c)  The  physical  security  of  the  data  center. 

d)  The  documentation  of  standards  and  procedures. 

An  internal  audit  of  data  processing  center  will 
normally  be  conducted  by  the  organization’s  own  staff. 
Areas  cf  primary  concern  will  generally  include: 
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a)  The  adherence  to  organization's  policies,  rules  and 
regulations. 

b)  The  efficient  use  of  resources. 

c)  The  physical  security  of  the  data  and  data  center. 

d)  The  documentation  of  standards  and  procedures. 

e)  The  lcng-range  resource  (facilities,  equipment,  etc.) 
planning. 

f)  The  audit  staff  involvement  in  system  design. 

While  the  data  processing  manager  does  not  have  the  option 
to  decline  an  audit,  it  is  in  the  best  interest,  of  the  data 
processing  center  to  view  the  audit  with  a  positive  attitude 
for  the  following  reasons:  [Bef.  30] 

a)  An  audit  cannot  be  avoided. 

b)  An  audit  is  an  excellent,  objective  source  of  opera¬ 
tional  improvement  suggestions. 

c)  An  audit  is  an  objective  benchmark  of  what  kind  of  job 
the  facility  is  doing. 

From  a  Navy-wide  standpoint,  the  ideal  situation 
would  be  to  audit  all  data  centers.  This,  however,  may  not 
be  possible  because  cf  the  number  and  geographic  dispersion 
cf  the  data  centers.  In  deciding  which  data  centers  to 
audit  or  ,  for  an  internal  audit,  whether  to  do  an  audit, 
the  following  criteria  may  be  used: 

a)  The  center  has  teen  audited  before  and  did  not  do  very 
well. 

b)  The  data  center  provides  services  for  other  activi¬ 
ties. 

c)  The  data  center  has  large  applications  to  manage  or 
controls  large  assets. 

d)  The  data  center  is  a  large  installation  in  terms  of 
hardware  or  personnel  and  represents  a  large  invest¬ 
ment  in  dollars  or  manpower. 

e)  Significant  changes  in  equipment,  mission  or  personnel 
have  occurred  since  the  last  audit. 


f)  The  operation  exposes  data  processing  personnel  to 
potential  for  fraud  or  loss  of  control  such  as  check 
writing,  payroll,  or  on-line  operations. 

g)  A  critical  computer-controlled  application  is  involved 
such  as  a  security  system,  computer-monitored  or 
computer-controlled  machinery. 

The  data  center  manager's  problem  is  ensuring  that 
enough  controls  are  in  place  to  not  only  ensure  that  the 
data  center's  operations  run  smoothly  but  also  that  the 
organization's  activities  are  auditable.  The  development  of 
the  management  control  system  must  include  methods  to  not 
only  provide  for  effective  and  efficient  resource  utiliza¬ 
tion,  but  also  include  a  structure  that  provides  information 
for  the  inevitable  audits. 


XI.  CRG flNIZ&TIOwlI  OBJECTIVES  AMD  THE  CONTROL  SYSTEH 


1.  GCALS  OP  A  CCHTBCI  SYSTEH 


The  primary  goal  of  a  data  center  in  its  most  general 
form  is  to  w  attain  user  and  data  center  objectives  through 
management  control  within  an  effectivlely  structured  organi¬ 
zation"  [Ref.  31],  The  management  control  system  is  a  set 
cf  processes  through  which  organizations  ensure  that  actual 
activities  conform  tc  planned  activities  [Ref.  32].  The 
control  system  must  be  a  dynamic  entity  capable  of 
responding  and  in  fact  stimulating  response  from  the  organi¬ 
zational  constituents  to  the  changing  goals  and  objectives 
cf  the  organization.  It  must  be  sensitive  to  the  changing 
demands  cf  the  organization’s  clients  and  provide  a  frame¬ 
work  for  efficient  and  effective  resource  utilization  in  a 
climate  cf  future  planning  and  current  organizational 
performance  monitoring.  Ultimately,  a  management  control 
system  answers  the  question  "How  are  we  doing?"  in  a  manner 
that  encompasses  the  organization's  financial  standing, 
cutput  or  production  performance,  status  of  current  projects 
and  progress  toward  the  long-range  organizational  strategy. 

Management  has  the  responsibility  tc  "define  the  general 
nature  of  the  organization  and  its  relation  to  the  world" 
[Ref.  33].  The  direction  the  organization  will  take  and  the 
results  the  organization  wishes  to  achieve  are  communicated 
by  management  in  the  form  of  objectives.  Time  limits  and 
specific  performance  measurements  are  assigned  to  these 
objectives.  "The  objectives  should  be  measurable,  attai¬ 
nable,  comprehensive,  and  relevant  to  the  data  center's 
needs"  [Ref.  34].  "An  objective  that  is  not  measurable  is 
frequently  not  an  objective  but  a  statement  of  function  or 


responsibility"  [Ref.  35].  To  avoid  an  atmosphere  cf  frus¬ 
tration,  resentment  and  job  dissatisfaction  among  data 
center  personnel,  the  objectives  must  also  be  attainable. 
"The  statement  of  objectives  is  a  key  element  in  a  manage¬ 
ment  control  system  because  an  organization's  effectiveness 
can  be  measured  only  if  actual  outputs  are  related  to  the 
objectives"  [Bef.  36]. 

Schaeffer  [Bef.  37]  suggests  that  the  objectives  for  a 
data  center  can  be  categorized  as  "user-oriented  objectives 
and  data  center  objectives.  CJser-orianted  objectives  are 
timely  processing  and  quality  cf  the  output."  These  two 
characteristic  are  net  mutually  exclusive  and  in  most  cases 
there  is  a  trade-off  not  only  in  the  user-oriented  require¬ 
ments  of  timeliness  and  quality  but  also  data  center  objec¬ 
tives  cf  cost  and  efficiency.  Again,  the  user-data  center 
communication  becomes  a  paramount  consideration  in  negoti¬ 
ating  the  standards  of  performance  required  to  produce  a 
quality  service  in  a  timely  fashion  to  the  user  within  the 
efficiency  and  cost  constraints  of  the  data  center 
resources.  Quality  of  output  is  a  difficult  standard  to 
specify  and  can  eften  only  be  stated  in  terms  of  what  job  or 
service  is  to  be  provided  and  what  actions  or  precautions 
can  be  taken  to  ensure  that  the  output  is  what  is  desired  by 
the  user.  Such  precautions  include  assurance  of  "backup  for 
protection  of  critical  files,  appropriate  response  to 
program  messages,  verification  cf  control  totals"  [Ref.  38], 
and  proper  processing  and  distribution  of  output. 

Four  critical  data-center-oriented  objectives  are 
[Ref.  39] 

1.  Efficiency.  "Doing  things  right",  concerned  with  the 
cost  of  resources  used  in  the  applications  [Ref.  40]. 
Getting  the  greatest  amount  of  productivity  from 
available  resources  with  cost  justification  for 
obtaining  the  improved  efficiency. 
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2.  Security.  Provide,  within  financial  limits,  the 
protection  of  equipment,  systems,  data  and  the 
personnel  and  premises. 

3.  Ccst.  "To  (reduce)  processing  costs  by  documenting 
the  causes  for  the  data  center's  costs...". 

4.  Morale.  "To  (improve)  personnel  morale  by  stressing 
and  stimulating  participation,  initiative,  and 
personal  improvement.  Data  center  performance  is 
affected  by  the  competency  and  industry  of  its 
personnel.  Ecth  management  and  staff  benefit  from 
management's  concern  for  personnel  morale." 

While  Schaeffer's  list  of  objectives  addresses  some  critical 
issues,  additional  important  objectives  that  are  applicable 
to  a  data  center  are  as  follows: 

1.  Service.  Timely  and  appropriate  quality  response  to 
customers. 

2.  Innovation.  Development  and  delivery  of  new  products 
and  services. 

3.  Planning.  Improvement  of  short  and  long-range  plan¬ 
ning  and  decision-making. 

4.  Effectiveness.  "Doing  the  right  things",  the  right 
choice  of  applications  for  computer  resources. 

[Bef.  41], 

5.  Control.  Controlling  performance  so  that  standards 
are  met. 

To  meet  these  data  center  objectives.  Cash  (Bef.  42] 
suggests  seme  broad  objectives  that  a  management  control 
system  must  meet: 

1.  "Facilitate  appropriate  communication  between  the 
user  and  deliverer  of  information  systems  (IS) 
services  and  provide  motive :ional  incentives  for  them 
to  work  together  on  a  day-to-day,  month-to-mont h 
basis.  The  management  control  system  must  encourage 
all  users  and  IS  to  act  in  the  best  interests  of  the 
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organization  as  a  whole.  It  must  motivate  users  tc 
use  IS  resources  appropriately  and  help  them  balance 
investments  in  this  area  against  those  ir.  ether 
areas.” 

2.  ’'Encourage  utilization  of  the  IS  department's 
resources,  and  ensure  that  users  are  educated  on  the 
potential  of  existing  and  evolving  technology.  In 
doing  so,  it  must  guide  the  transfer  of  technology 
consistent  with  strategic  needs.” 

3.  "It  must  provide  the  means  for  economical  management 
of  IS  resources  and  give  necessary  information  for 
investment  decisions.  This  requires  development  of 
both  standards  of  performance  measures  and  the  means 
tc  evaluate  performance  against  those  measures  to 
ensure  productivity  is  being  achieved.  It  should 
help  facilitate  make-or-buy  decisions.” 

The  management  control  system  must  not  be  limited  to  only 
financial  controls  but  should  include  such  things  as  surveys 
of  user  attitudes  about  the  IS  support  provided,  personnel 
turnover  trends,  measures  of  operational  service  levels 
(network  uptime,  jot  re-runs,  response  time,  transactions 
processed,  etc.)  and  reports  on  the  status  and  development 
cf  projects. 

E.  ORGANIZATION AL  VS.  INFO  EMATION  RESOURCE  PLANNING 

Information  resource  planning  and  organizational  plan¬ 
ning  should  be  compatible  in  most  respects.  There  will 
however  be  differences,  especially  in  the  area  of  planning 
time  horizons  for  the  organization  and  the  data  center,  user 
planning  reguiremnets  and  planning  inputs,  and  evaluation  by 
economic  analysis  of  future  plans. 
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1 .  Organizational  Plan  s  vs.  In  formation  Resource  Plans 

Ids  ally,  both  organizational  planning  and  control 
system  and  information  resource  planning  and  control  sysoem 
will  be  on  multiyear  plans.  The  conflict  occurs  however 
when  the  organizational  planning  is  keyed  to  the  annual 
budget  cn  a  short-term  basis  and  the  information  resource 
planning  is  linked  tc  project  life-cycle  management.  The 
project  life-cycle  can  easily  take  more  than  three  years 
with  as  much  as  a  year  to  finalize  the  design  approach 
[Ref.  43],  The  data  center  manager  must  therefore  extend 
the  planning  horizon  to  at  least  a  three-year  view  tc  ensure 
adequate  resources  are  available  to  support  the  organiza¬ 
tional  strategy. 

The  key  to  resolving  the  planning  time  horizon 
problem  lies  in  the  data  center  manager's  involvement  in  the 
formulation  and  execution  of  the  organizational  planning  and 
control  process.  The  data  center  manager  must  be  aware  of, 
and  provide  substantive  inputs  to  the  overall  organizational 
planning  in  three  key  management  areas: 

a)  The  data  center  planning  and  project  life-cycle 
management  effort  must  "systematically  and 
precisely  identify  alternative  steps  for  providing 
necessary  services"  [Ref.  44].  In  addition  tc 
being  responsive  to  changing  organizational  goals, 
the  data  center  management  must  be  responsive  to 
changing  organizational  plans  that  are  brought 
about  by  budgetary  constraints.  This  can  best  be 
dens  by  knowing  the  overall  organization's  control 
system  and  the  "scoreboard"  upon  which  organiza¬ 
tional  operations  are  based.  For  instance,  if  the 
organization  is  constrained  by  quarterly  operating 
budget  funds,  then  the  data  center  manager  must  be 
prepared  tc  initiate  innovative  operating  plans  to 
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meet  the  service  requirements  of  a  user  at  a  cost 
that  will  be  within  the  financial  constraints  of 
the  budget.  The  user  and  data  center  ma ragement 
may  have  tc  alter  the  time  the  services  are  tc  be 
performed  to  take  advantage  of  "idle”  demand 
pricing,  change  the  pricing  scheme  or  divert/ 
postpone  ether  services  until  the  financial 
constraints  are  eased.  In  any  event  the  data 
center  management  must  remain  flexible  and  sensi¬ 
tive  to  the  problems  and  requirements  of  the  users 
of  the  data  center’s  services. 

b)  Eata  center  management  must  be  aware  of  how  the 
data  center’s  management  control  system  fits  into 
the  organizational  management  control  system.  If 
cue  of  the  organization's  performance  measures  is 
inventory  management,  then  the  data  center  should 
have  a  performance  measure  that  specifically 
addresses  how  the  data  center  operations  are 
supporting  the  inventory  management  system.  The 
data  center  should  be  able  to  provide  statistical 
data  cn  such  things  as  number  of  line  items 
issued,  amount  and  number  of  interdepartmental 
billings  and  the  cost  of  running  the  inventory 
management  system,  where  differences  exist  in  the 
organizational  and  data  center  management  control 
systems,  the  data  center  manager  must  be  able  to 
reconcile  these  differences  and  have  some  knowl¬ 
edge  as  to  the  effects  these  differences  may  have 
in  achieving  the  lcng-term  strategic  goals  of  the 
organization. 

c)  There  is  a  dichotomy  between  the  issues  of  control 
and  innovation.  The  control  issue  normally  encom¬ 
passes  comparison  cf  actual  expenditures  to  the 
budget  anc  measurement  of  actual  performance 
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versus  planned.  Innovation  on  the  other  hand 
involves  experimentation  with  new  t echroic ci=s , 
emergence  cf  new  user  applications  and  a  willing¬ 
ness  to  try  new  or  unproven  techniques.  If  there 
is  agreement  on  the  balance  of  innovation  and 
control  at  the  organizational  level  and  the  data 
center  level,  then  little  conflict  is  present. 
If,  however,  there  is  a  difference,  whether  orga¬ 
nizational  management  or  data  center  management 
supporting  control  versus  innovation,  the  differ¬ 
ence  must  be  resolved.  Generally,  the  imoetus  for 
innovation  will  come  from  users  with  new  applica¬ 
tions  request. 

The  data  center  management  control  system  must 
address  the  legitimacy  of  new  applications  and  provide  a 
framework  of  integrating  the  new  applications  into  the  data 
center  operations  if  the  request  can  be  reasonably  imple¬ 
mented.  The  data  center  management  control  system  must  be 
formulated  with  a  sense  for  the  organizational  committment 
to  control  or  innovation.  If  the  organization's  position  is 
one  primarily  of  control,  then  the  data  center  management 
control  system  must  be  oriented  to  evaluate  the  new  applica¬ 
tions  in  strict  cost-benefit  terms  and  will  have  a  major 
impact  or.  whether  the  application  is  implemented.  If  the 
organization  is  innovation- inclined  then  the  evaluation  cf  a 
new  application  may  be  a  process  where  the  cost  of  the  new 
application  is  documented  by  the  data  center's  control 
system  but  the  decision  to  implement  the  new  application  is 
a  subjective  determination.  The  data  center  management 
control  system,  therefore,  has  to  support  the  organizational 
balance  between  control  and  innovation. 
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2  •  Oser  In  vol ve  ment 

There  can  be  significant  conflict  between  the  data 
center's  planning  scheme  and  that  of  the  users.  The  users, 
whether  cr  not  a  part  of  the  formal  organization,  have  a 
dramatic  impact  on  the  future  of  the  data  center.  As 
discussed  earlier,  reccnci lation  of  innovation  and  control 
between  the  user's  requirements  or  requests  and  the  services 
provided  by  the  data  center  can  be  of  pivotal  importance. 
At  the  heart  of  the  user/data  center  interface  is  the 
control  issue.  The  user  is  often  driven  to  focus  on  the 
solution  tc  short-term  problems  where  the  data  center  may  be 
concentrating  on  new  technological  advancements,  lcng-term 
resource  utilization  and  an  orderly  development  of  resources 
to  meet  long-term  requirements.  Cash  [Ref.  45]  suggests 
that  this  facet  of  the  control  issue  can  lead  to  "tension 
between  IS  dominance  and  user  dominance  in  the  retention  of 
development  skills  and  also  in  the  active  selection  of 
priorities. " 

There  are  many  reasons  users  may  wish  to  exert  a 
dominant  role  in  the  control  of  their  computing  applica¬ 
tions.  If  the  data  processing  center  has  a  backlog  of 
development  of  new  applications,  the  user  may  wish  to  seek 
alternative  sources  for  development  of  new  applications. 
The  proliferation  of  stand-alone  computer  systems  and  off- 
the-shelf  software  make  an  attractive  solution  to  the  users 
requirements  when  compared  to  the  relatively  long  lead-time 
response  of  the  data  center.  The  user  may  see  stand-alone 
systems  as  a  means  to  gain  control  over  the  daily  opera¬ 
tions,  maintenance  and  development  priorities.  Cash 
[Ref.  46]  refers  to  these  user-oriented  measures  as  "short¬ 
term  user  driven"  pressures  toward  user  dominance. 
Conversely,  Cash  has  identified  some  pressures  that  drive 
the  data  center  toward  dominance  of  control  [Ref.  47] 


a)  "Staff  Professionalism; 

1)  ...provides  an  opportunity  to  attract  and  keep 
challenged,  specialized  technical  individuals. 

ii)  ...  easier  to  develop  and  enforce  betrer  stan¬ 
dards  of  IS  management  practice  in  a  large 
group. 

iii)  Lacking  practical  systems  design  experience  and 
purchased  software  standards,  the  user  often 
ignores  normal  data  control  procedures,  documen¬ 
tation  standards,  and  conventional  costing  prac¬ 
tices." 

b)  "Feasibility  Study  Concerns;  ...  user-driven  feasi¬ 
bility  study  may  contain  some  major  technical 
mistakes,  resulting  in  the  computer  system  being  inad¬ 
equate  to  handle  growing  processing  requirements  ...". 

c)  Organizational  "Data  Ease  System;  ...  collection  of 
files  at  a  central  location  for  reference  by  multiple 
users 

d)  "Fit  to  (organizational)  structure  and  Strategy;  ... 
centrally  directed  planning  and  operational  control 

. . . " . 


e)  "Ccst  Analysis;  A  significant  edge  that  a  centralized 
IS  group  has,  through  their  practical  experience  in 
other  system  efforts,  is  the  ability  to  produce  a 
realistic  software  development  estimate  which  takes 
into  account  the  interests  of  the  (organization)  as  a 
whole." 

Figure  2.1,  excerpts  from  (Ref.  48],  illustrate  some  conse¬ 
quences  of  either  excessive  data  center  or  excessive  user 
domination; 
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IS 


Tcc  much  emphasis  cn  data 
base  hygiene 

New  systems  always  must 
fit  data  structure  of 
existing  system. 


All  reguests  for  service 
require  system  study 
with  benefit  identi¬ 
fication 


Standardization  dominates 
—  few  exceptions. 


IS  desigr.s/constructs 
everything. 


0SE3 


Too  much  emphasis 
on  problem  focus 

IS  says  out  of 
control 


Explosive  growth  in 
number  of  new 
systems  and  staff 


Lack  of  standardi¬ 
zation  and  control 
over  data  hygiene 
and  system. 

Hard  evidence  of 
benefits  dees  not 
exist. 


Study  always  shows 
construction  costs 
less  than  outside 
purchase. 


IS  specializing  in 

in  technical  frontiers 
not  user-oriented 
markets. 

IS  spending  8  0*  on 
maintenance,  20* 
cn  development. 


IS  thinks  they  are  in 
control  of  all. 


Users  express  unhappiness. 

No  strong  user  group  exists. 

General  management  not 
involved  but  concerned. 


User  buyino  design/ 
construct ion/main¬ 
tenance  servic°s 
and  even  operation 
services  from  out¬ 
side. 

User  building  net¬ 
works  to  own  needs 


No  coordinated 
effort  for  tech¬ 
nology  transfer 
or  learning  from 
experience  between 
users. 

Communications  costs 
are  rising  dramat¬ 
ically  throuoh  re¬ 
dundancy. 
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Figure  2.1  Possible  Implications  of  Excess  Dominance 


Bor  instance,  if  there  is  IS  dominance  then  there  will  be 
too  much  emphasis  on  data  base  hygiene  at  the  expense  of 
user  innovation.  If  there  is  user  dominance  then  there  may 
be  a  lack  of  standardization  which  could  hamper  system  inte¬ 
gration  cr  maintenance. 

A  clear  definition  of  user  and  data  center  responsi¬ 
bilities  can  help  alleviate  seme  of  the  conflict  between 
users  and  the  data  center  in  establishing  computing  service 
policies.  The  following  is  a  representative  list  of  respec¬ 
tive  functions  needed  in  development  of  new  applications 
[Ref.  49] 

a)  "IS  (cata  center)  Responsibilities; 

i)  "De velopmnet  of  procedures  to  ensure  that  ...  a 
comparison  is  made  of  internal  development 
versus  purchase...". 

ii)  "Maintenance  of  an  inventory  of  installed  or 
planned-to-be  installed  information  services." 

iii)  "Development  and  maintenance  of  a  set  cf  stan¬ 
dards  which  establish; 

•  Mandatory  communication  standards. 

•  Standard  languages  for  classes  of  acquired 
equipment. 

•  Documentation  procedures  for  different  types 
of  systems. 

•  Corporate  (organizational)  data  dictionary 

with  clear  definitions  for  when  elements  must 
be  included.  Identification  of  file  mainte¬ 
nance  standards  and  procedures. 

•  Examination  procedure  for  systems  developed  as 

independent  islands  to  ensure  that  they  dc  not 
conflict  with  corporate  (organizational)  needs 
and  that  any  necessary  interfaces  are 

constructed. 
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iv)  Identification  and  provision  of  appropriate  IS 
development-staff  career  paths  throughout  the 
organization. 

v)  Preparation  of  a  detailed  checklist  of  questions 
to  be  answered  in  any  hardware/software  acquisi¬ 
tion  to  ensure  that  relevant  technical  and  mana¬ 
gerial  issues  are  raised  ...  ". 

•  How  proposed  system  meets  communication  stan¬ 
dards? 

•  For  word  processing  systems,  upward  growth 
potential,  built-in  communication  and  data 
processing  capabilities. 

•  For  data  processing  systems,  availability  of 
languages  which  support  systems  growth  poten¬ 
tial  and  available  word  processing  features. 

•  For  communication  systems,  the  types  of  data 
transfer  capabilities,  list  of  available 
services,  storage  capacity,  etc. 

vi)  Est atlis tment  of  education  programs  for  poten¬ 
tial  users  ... 

vii)  An  ongoing  review  of  which  systems  are  not 
feasible  to  manage  and  which  should  be  rede¬ 
signed.  n 

b)  "User  Responsibilities; 

i)  Maintain  a  financial  control  system  of  all  user 
IS-type  activities. 

ii)  Make  an  appraisal  of  the  user- people  investment 
for  each  new  (application)  ,  in  both  the  short¬ 
term  and  long-term,  to  ensure  a  satisfactory 
service. 

iii)  Develop  a  comprehensive  user  support  plan  for 
(applications)  that  will  support  vital  aspects 
of  the  (organization)  or  that  will  grew  in  use. 
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i7)  Manage  tie  is/user  interface  consistently  vith 
its  strategic  relevance,  as  an  integral  aspect 
of  the  (organization)  . 

v)  Perform  periodic  audits  on  the  appropriateness 
of  system  reliability  standards,  communication 
services,  and  security  requirement  documenta¬ 
tion  . " 

These  responsibilities  can  assist  the  user  and  data  center 
manager  in  determining  their  respective  roles  ir.  the  long- 
range  and  short-range  planning  of  new  applications  and 
resource  utilization.  Both  user  and  data  center  management 
have  an  obligation  to  fulfill  these  requirements  if  the 
pitfalls  of  user  dominance  or  data  center  dominance  shown  in 
figure  2.1  are  to  be  avoided. 

3 .  Economic  Analysis 

"Economic  analysis  is  a  systematic  approach  to  eval¬ 
uating  the  relative  worth  of  proposed  projects"  [Ref.  50]. 
As  an  integral  part  of  planning,  the  examination  cf  the 
costs,  benefits  and  uncertainities  cf  a  proposal  make 
economic  analysis  a  tool  in  evaluating  the  economic  conse¬ 
quences  of  a  present  plan  cr  the  appropriate  course  of 
action  tc  follow  in  the  future.  Economic  analysis  provides 
an  input  to  a  decision-making  process  by  indicating  hew  to 
get  the  most  for  the  resources  expended  versus  the  least 
expensive  solution. 

The  data  processing  center  manager  can  use  economic 
analysis  techniques  as  a  valuable  tool  in  evaluation, 
contrcl,  and  make-or-buy  decisions  for  new  projects  and  new 
applications.  As  an  evaluation  tool,  economic  analysis  can 
provide  a  mechanism  fer  comparison  of  new  applications  with 
the  alternatives  in  a  standardized  method.  Without  seme 
standardized  comparison  criteria  the  alternatives,  wherher 
it  be  in-house  development  cf  software  cr  whether  or  not  an 
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alternative  is  in  fact  economically  feasible,  can  be  biased. 
The  evaluation  of  new  projects  or  new  applications  is  diffi¬ 
cult  given  that  each  application  will  have  varying  benefits, 
costs,  life-cycles,  and  will  have  a  different  impact  on  the 
resource  system  as  a  whole.  Economic  analysis  techniques 
can  provide  a  common  basis  upon  which  the  data  processing 
center  can  base  an  evaluation  cf  a  project.  Again,  user 
involvement  is  a  key  ingredient  in  the  formulation  of  the 
economic  analysis.  The  user  is  in  a  position  to  know  the 
benefits  of  new  applications  but  the  user  must  be  educated, 
depending  of  course  cn  the  sophistication  of  the  user,  or. 
how  best  tc  state  those  benefits  in  measurable1  terms  that 
can  be  incorporated  into  an  economic  analysis  methodology. 
The  user  must  also  be  familiar  with  the  economic  analysis 
techniques  themselves  so  that  they  will  have  an  appreciation 
for  the  value  of  economic  analysis  in  life-cycle  planning 
and  decision-making. 

There  is  a  complex  interface  between  the  economic 
analysis  of  new  projects  and  the  management  control  system. 
In  fact,  "any  econcmic  analysis  is  done  in  context  of  the 
control  system"  [Ref.  51].  For  instance,  if  the  control 
system  includes  a  chargeback  scheme,  then  the  economic  anal¬ 
ysis  should  include  an  examination  of  the  transfer  prices, 
likewise,  the  period  over  which  the  economic  analysis  is 
based,  the  economic  life,  should  be  the  same  as  the  life- 
cycle  cf  the  project.  When  the  interface  between  the 
economic  analysis  of  a  project  and  the  management  control 
system  is  in  the  analysis,  the  alternatives  can  be  more 
readily  compared  in  common  terms  and  will  facilitate  the 
incorporation  of  the  new  project  into  the  management  control 
system.  There  are  of  course  instances  where  new  projects 
will  have  characteristics  that  can  not  be  put  in  terms 


‘In  an  economic  sense. 
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ccaacc  to  an  econcpmic  analysis  methodolgoy  and  the 
management  control  system.  For  instance,  a  software  monitor 
nay  be  dependent  on  a  specific  hardware  configuration  which 
has  a  life-cycle  of  eight  years.  The  software  monitor's 
life-cycle  in  terms  of  utilization  by  the  management  control 
system  may  be  a  much  longer  period.  The  inconsistency  must 
be  resolved,  but  more  importantly,  -he  difference  will  have 
to  be  considered  in  the  planning  of  the  manage  men1:  control 
system  for  the  future.  The  economic  analysis  process  itself 
is  a  complex  and  expensive  endeavor  that  may  not  be  justi¬ 
fied  for  projects  whose  costs  do  not  exceed  the  historical 
cost  of  conducting  the  economic  analysis.  It  can  however, 
provide  a  valuable  input  on  the  decision  cf  hew  zc  or 
whether  to  develop  and  implement  a  large,  new  service 
project.  The  economic  analysis  procedure  recommended  by 
Zimmerman  [Hef.  52]  consists  cf  six  hey  elements: 

a)  "Establish  and  define  the  goal  or  objective.  It 
should  reflect  a  totally  unbiased  point  of  view 
ccrceming  the  method  of  solving  the  problem." 

b)  "Formulate  appropriate  assumptions.  Assumptions  are 
explict  statements  used  to  describe  the  present  and 
future  environment  upon  which  the  economic  analysis  is 
based." 

c)  "Search  out  alternatives  for  accomplishing  the  objec¬ 
tive.  Identify  all  feasible  means  of  meeting  the 
objective.  " 

d)  "Determine  the  costs  (inputs)  and  the  benefits 
(output)  of  each  alternative.  This  is  usually  the 
most  difficult  and  time-consuming  step." 

e)  "Test  the  sensitivity  of  the  analysis  outcome  to  major 
uncert aint ies. " 

The  user's  request  for  a  new  application  or  project 
is  usually  identified  on  seme  form  of  "information  service 
request"  or  "project  request".  The  user's  input  into  the 
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economic  analysis  of  a  project  or  application  is  "antici¬ 
pated  benefits"  or  "costs  savings".  These  benefits  and' 
costs  savings  should  be  expressed  as  much  as  possible  in 
quantifiable  terms.  A  common  pitfall  is  to  confuse  benefits 
with  cost  savings.  The  economic  analysis  should  consider 
benefits  and  costs  savings  in  the  appropriate  economic  anal¬ 
ysis  methodology .  A  particularly  difficult  problem  associ¬ 
ated  with  economic  analysis  is  the  estimation  of  software 
costs.  There  are  many  software  cost  estimation  models 
available  that  can  be  used  if  the  new  application  meets 
specific  parameters.  It  has  been  suggested  [Bef.  53]  that  a 
more  reasonable  approach  tc  software  cost  analysis  is  to 
compare  common  elements  of  the  new  application  to  applica¬ 
tions  that  have  been  implemented  in  the  past.  This  of 
course  is  dependent  upon  the  availability  of  past  project 
cost  data.  Figure  2.2  lists  some  of  the  project  cost  data 
that  may  be  useful  in  developing  an  in-house  model  of 
project  cost  estimation.  * 

There  is  a  significant  trade-off  in  requiring  the 
preceding  economic  analysis  techniques  to  be  calculated  if 
the  process  discourages  creativity  and  user  program  innova¬ 
tion.  The  data  center  must  decide  if  and  how  tc  employ 
these  economic  analysis  techniques  and  must  consider; 

a)  The  data  center’s  current  hardware  capacity  and 
prcqrammer  availability. 

b)  The  impact  on  user’s  requests. 

c)  How  quantifiable  are  the  benefits  and  costs  of  a 
Frcject. 

d)  Does  the  benefit  of  the  economic  analysis  outweigh  the 
costs. 

The  management  control  system  must  address  how  the 
data  center  will  evaluate  and  control  the  ^mergence  of  new 
applications.  The  rcle  of  the  management  control  system  in 
the  task  of  evaluating  the  eccncmic  feasibility  of  projects 
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-  Project  Name 

-  Description  of  major  functions 

-  Lines  of  code 

-  Relative  complexity  on  scale  1  to  10 

-  Effort  (man-months) 

-  Development  time  (months) 

-  Number  of  people 

-  Project  cost 

-  Tcials  for  major  functions 

-  Documentation  (  number  of  pages  ) 

-  Total  staff 

-  Tools  used  (  hardware  and  software  ) 

-  Maintenance  reccrd  to  date 

-  Programmer  productivity 

-  Lines  of  project  code  per  week 

-  Hcurs  spent  in  library  updating 

-  Hcurs  spent  on  non-project  work 

.  .  ■  . . . 1 


Figure  2.2  Project  Cost  Data  Elements. 

is  in  the  collection  of  data  for  comparison  of  key  elements 
of  new  project  proposals  tc  similar  projects  in  the  past. 
The  management  ccntrcl  system  can  control  the  growth  of  new 
applications  by  requiring  cost/berefit  analysis  of  major  new 
projects  and  provide  the  user  with  an  opportunity  to  decide 
whether  cr  not  the  new  application  is  worth  the  investment. 
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III.  EIEEESTS  CF  J  CONTROL  SYSTEM 


The  control  system,  when  referring  to  it  strictly  in  the 
managerial  sense  without  regard  to  specific  controls  for  a 
computer  facility,  can  be  viewed  simplistically  as  the  set 
cf  processes  through  which  organizations  ensure  that  actual 
activities  conform  tc  planned  activities.  Within  this  frame 
cf  reference  Stoner  (Ref.  54}  has  identified  four  elements 
of  a  control  system:  (1)  the  establishment  of  standards  and 
measures;  (2)  the  measurement  of  performance;  (3)  the 
comparison  of  performance  against  standards;  and  <4)  the 
taking  of  corrective  action. 

The  nature  of  a  computing  facility's  operations, 
however,  requires  a  more  comprehensive  view  owing  to  seme 
unique  char acter ist ics.  Consideration  must  be  giver,  to  the 
effect  of  costing  schemes  or  the  degree  of  centralization 
versus  decentralization  in  the  organization. 

Decentralization  will  allow  an  organization  to  have  decision 
making  dene  at  the  lowest  possible  level  as  opposed  to  a 
centralized  structure  which  may  not  include  lower  level 
management.  The  relationship  between  performance  measure¬ 
ment  and  goal  congruency  has  an  effect  on  the  type  of 
control  system  that  car  be  used.  Ouchi's  paradym  (Ref.  55] 
discusses  two  fundamental  questions  in  determining  the 
appropriate  form  of  management  control;  "the  clarity  with 
which  performance  can  be  assessed"  and  the  "degree  of  goal 
incongruence".  Ouchi  states  that  a  high  level  of  goal 
incongruence  can  be  tolerated  where  performance  can  he  meas¬ 
ured  with  precision.  Where  performance  is  qualitative  in 
nature,  the  goal  congruence  of  all  personnel  becomes  vitally 
important. 
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The  role  of  the  management  control  system  in  a.  ccmpu-ing 
organization  will  be  influenced  by  the  snage  of  techno¬ 
logical  growth  as  proposed  by  Nolan  [Ref.  56],  As  the  orga¬ 
nization  passes  through  each  of  the  four  stages:  initiation, 
contagion,  integration,  and  control;  the  management  control 
system  takes  on  a  mere  active  role.  "At  one  time  it  is 
necessary  to  relax  and  let  the  organization  search  for 
effectiveness  while  at  another  it  is  necessary  to  test  effi¬ 
ciency  to  maintain  control"  [Bef.  57].  Other  recurring 
themes  that  appear  ir  the  literature  or.  computing  facility 
control  systems  are  the  relationship  of  the  standards  of 
performance  and  the  erganiz aticnal  goals  and  objectives,  th» 
prioritization  of  jobs,  or  the  use  of  management  reports  as 
an  element  cf  the  cortrol  system. 

Stoner's  list  of  elements  of  a  control  system  can  be 
expanded  tc  incorpcrate  the  more  specific  and  unique 
requirements  of  a  control  system  for  a  computer  facility. 
The  elements  of  a  management  control  system  are: 

a)  the  centralized  or  decentralized  organization  and  its 
relatioship  with  the  control  system 

b)  the  costing  schemes 

c)  the  development/review  of  standards  compatible  with 
organizational  objectives 

d)  the  measures  of  performance 

e)  the  comparison  cf  performance  to  standards 

f)  the  prioritization  of  jobs 

g)  the  management  reports 

h)  the  taking  of  corrective  actions 

1.  OBGANIZ1TIOHAL  STBOCTOBE  AND  THE  CONTROL  STSTEfi 

The  control  system  can  cause  the  organization  to  be  more 
centralized  or  less  centralized  depending  on  where  the 
ccntrcl  system  fits  into  the  organization.  Top-level 


management  can  manipulate  the  control  system  to  take  advan¬ 
tage  cf  the  speed  and  flexibility  of  the  system  to  bring  the 
decision  process  to  the  front  office  and  eliminate  depen¬ 
dence  cr.  subordinates  for  judgemental  and  experience  inputs. 
However,  the  control  system  is  best  implemented  in  support 
cf  a  decentralized  organization  providing  a  basis  for  the 
projection  cf  decision-making  down  to  the  lewast  management 
level.  If  the  control  system  is  a  tool  for  department 
heads,  it  can  provide  lower  level  managers  with  information 
to  make  more  effective  decisions  and  provide  an  opportunity 
for  enhancement  of  creativeness  and  adaptiveness  cf  lower 
level  management.  It  will  alsc  allow  upper  management  to 
assign  authority  and  responsibility  for  decision-making  at 
the  lowest  levels.  Exactly  how  the  management  control 
system  functions  in  a  completely  centralized,  completely 
decentralized,  or  distributed  processing  data  center  organi¬ 
zation  will  be  discussed  later. 

E.  CCST3NG  SCHEHES 

Charging  internally  for  the  use  cf  central  computer 
facilities  is  becoming  a  ccmmcn  organizational  practice. 
"The  decision  to  impose  a  charging  system,  whereby  a  previ¬ 
ously  free  service  is  converted  into  one  for  which  users  are 
charged,  fundamentally  alters  the  relationship  between  the 
user  and  the  computer  facility.  A  chargeback  policy  can 
play  a  major  role  in  promoting  effective  and  efficient 
utilization  of  scarce  computing  resources”  [Ref.  58].  in 
practice,  however,  charging  all  too  often  fails  to  have 
significant  beneficial  impact,  and  can  be  a  source  of 
tensions  and  user  dissatisfaction  [Ref.  59],  Chargeback 
systems  are  most  likely  to  be  successful  when  th8y  are  based 
cn  an  understanding  cf  the  purposes  underlying  the  charging 
system  [Ref.  60]. 
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A  chargeback  system,  like  any  management  control  tool, 
must  be  designed  in  relation  to  the  particular  situation 
involved.  The  nature  of  its  computing  activities,  the 
sophistication  of  its  users,  and  other  factors  unique  to 
that  organization  will  determine  the  chargeback  system 
features  test  suited  to  a  particular  organization.  Most 
significantly,  the  design  of  the  chargeback  system  must 
reflect  management's  objectives  in  controlling  computing 
activitiss  and  what  rcle  management  wishes  charging  to  play 
in  the  control  process.  Management's  objectives  in  charging 
for  computer  services  may  vary  from  one  organization  to 
another,  hcwever,  the  primary  objectives  are  typically  all 
related  in  some  way  to  control  of  the  organization's 
computing  activities. 

Another  significant  factor  in  the  design  of  a  chargeback 
system  is  the  ability  to  measure  either  output  or  process. 
The  feasibility  to  measure  desired  performance  with  reason¬ 
able  precision  is  an  essential  element  underlying  the  struc¬ 
ture  of  the  chargeback  system.  [Ref.  61].  The  user's 
perception  cf  validity  and  fairness  in  the  chargeback  sys-em 
will  depend  on  the  selection  of  measurement  criteria  that 
are  understandable  and  accurately  reflect  resource  usage 
(BERNARD),  when  the  assessment  of  measurable  elements  indi¬ 
cates  that  it  is  not  possible  tc  measure  either  process  or 
outputs  with  any  amount  of  accuracy  or  lack  of  ambiguity,  a 
chargeback  system  may  be  inappropriate  [Ref.  62]. 

The  primary  reasons  for  charging  for  a  computer  resource 
is  based  on  a  desire  to  recover  costs,  effectively  allocate 
the  computer  resource  or  regulate  the  demand  for  the 
computing  resource  [Ref.  6  3].  A  costing  scheme  must  be 
selected  to  achieve  an  optimum  of  all  three  basic  desires 
and  be  ccmpatiable  with  the  mechanism  with  which  the  ccstino 
will  be  controlled.  The  cost  recovery  aspect  will  provide 
performance  (fiscal)  data  on  service  departments.  Effective 
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allocation  cf  the  computer  resource  can  be  accomplish*!  with 
a  discriminating  prioritization  policy  once  then®  is  a  real¬ 
ization  that  the  computer  is  a  limited  resource. 

The  organization's  management  must  consider  several 
aspects  of  the  computing  activities  to  be  controlled. 
Operationally,  the  organization  must  ensure  that  the  users 
are  efficient  and  effective  in  their  utilization  cf  the 
computing  resources.  The  computer  facility  itself  should 
have  incentive  to  operate  efficiently  and  be  responsive  to 
user  requirements.  In  an  environment  where  users  have  free 
access  to  the  computing  resources,  it  may  be  desirable  to 
limit  total  demand  for  these  resources  to  the  available 
capacity  and  to  minimize  the  problems  that  can  be  caused  by 
load  fluctuations. 

Bernard  [Ref.  6 *» 3  contends  that  charge-out  systems 
consist  of  two  interdependent  components;  a  budgeting 
process  and  a  pricing  scheme.  The  budgeting  process  is  the 
mechanism  through  which  the  organization  plans  the  provi¬ 
sions  of  computing  resources  and  determines  their  alloca¬ 
tion.  The  pricing  scheme  measures  and  provides  a  basis  for 
controlling  users  consumption  of  these  resources. 

Management's  view  of  the  role  a  charging  system  should 
play  in  the  overall  management  control  process  of  the 
computer  facility  will  determine  what  functions  are 
performed  by  any  particular  charging  system.  The  functions 
will  also  depend  on  how  well  the  charging  system  is  designed 
to  effectively  carry  out  its  intended  role.  Some  of  the 
functions  a  charging  system  can  provide  are  listed  below 
[Ref.  65]. 

a)  Provide  management  information  for  resource  control 
and  decision-making. 

b)  Provide  a  means  of  allocating  resources  among  users. 

c)  Encourage  users  to  employ  computing  resources  effec¬ 
tively  and  efficiently. 
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d)  Promote  effective  and  efficient  provision  of  services 
ty  the  computer  facility. 

e)  Permit  decentralization  of  control  over  resource  allo¬ 
cation  decisions. 

To  be  fully  effective,  a  charging  system  needs  to  be 
tailored  to  the  objectives  it  is  to  serve  as  defined  by 
management.  charging  is  all  too  often  regarded  as  an 
accounting  mechanism,  rather  than  a  control  tool  that  can  be 
tailored  to  management's  needs.  While  the  main  purpose  of 
equitable  cost  allocation  is  certainly  one  of  the  functions 
of  a  charging  system;  it  also  ensures  that  computing  costs 
are  utilized  in  management  information  used  for  evaluation 
and  decision-making.  Viewing  charging  purely  as  a  cost 
mechanism  fails  to  recognize  that  charges  have  a  direct 
influence  on  user  attitudes,  behavior,  and  decisions.  The 
main  motivation  behind  a  charging  system,  therefore,  is  to 
control  computing  activities  through  this  user  influence. 

C.  DEVE1CP BEHT  OF  STABDABDS 

Performance  standards  are  statements  of  what  should  be 
done  to  meet  the  organization's  objectives.  They  are 
expressed  in  terms  that  permit  determination  of  whether  a 
certain  measure  of  performance  has  been  reached. 
Performance  standards  are  set  at  each  level  of  the  organiza¬ 
tion  and  should  be  comprehensive  in  addressing  the  contribu¬ 
tion  that  is  expected  of  each  level  of  management  in  the 
achievement  of  the  organizational  goals. 

Performance  standards  must  be  precise  and  communicated 
to  appropriate  levels  of  management.  Since  different  orga¬ 
nizational  groups  will  have  different  functions  and 
contribute  in  various  ways  to  the  organization,  the  stan¬ 
dards  for  each  organizational  group  must  be  formulated  such 
that  there  is  no  conflict  between  groups.  In  other  words. 


the  performance  measure  of  cne  group  should  not  b«  at  at  the 
expense  cf  the  performance  of  another  group.  Each  standard 
should  relate  to  a  specific  organizational  goal.  Once  stan¬ 
dards  are  set,  there  must  be  continual  review  to  ensure  that 
the  validity  of  the  standard  and  performance  level  required 
by  the  standard  is  consistent  with  the  progress  toward  the 
goals  and  objectives.  The  standards  should  be  challenging 
but  attainable. 

The  selection  of  standards  is  a  difficult  task.  The 
performance  task  must  be  analyzed  to  determine  what  steps 
are  involved,  what  parameters  can  be  measured,  and  the 
impact  cf  specific  variables  on  that  task.  The  standards 
should  net  cnly  be  an  indicator  of  variant  performance,  but 
should  also  be  a  deterrent  to  performance  that  is  below  what 
is  expected  in  that  task.  like  most  aspects  of  control,  the 
selection  of  an  appropriate  standard  involves  evaluation  cf 
the  benefit  to  monitor  a  certain  performance  level  and  the 
cost,  usually  in  overhead,  to  obtain  the  performance  infor¬ 
mation.  There  can  be  a  tradeoff  in  selection  of  the  "best" 
performance  characteristic  to  set  as  a  standard  and  the  cne 
which  can  be  measured  more  economically. 

D.  HIAStJHIS  OP  PERPCSM&NCE 

The  monitoring  of  computer  system  performance  is  neces¬ 
sary  to  ensure  that  surprises  do  not  occur  that  may  lower 
overall  effectiveness  [Ref.  66].  "Performance  measurements 
should  be  conducted  in  pursuit  of  some  specific  and  achiev¬ 
able  goals"  [Ref.  6‘7].  The  measurement  process  itself  is 
central  to  the  operation  of  a  control  system  and  is  a  neces¬ 
sary  condition  for  control  to  occur  [Ref.  68],  what  is 
measured,  however,  is  rarely  performance  per  se  but  seme 
specific  attribute  related  tc  performance.  The  users  of 
systexs  interact  with  the  systems  directly,  but  the  data 
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describing  the  system  relates  to  attributes  or  an  exrer.- ior. 
cf  the  system  and  net  the  system  itself.  The  choice  of 
measurements  or  attributes  to  be  measured  is  therefore  a 
significant  decision. 

The  three  fundamental  frameworks  of  market,  bureaucracy 
cr  clan  discussed  earlier  are  specifically  delineated  by  the 
ability  tc  measure  either  outputs,  processes,  or  social 
indicators  [Ref.  69].  This  fundamental  issue  of  assessing 
which  performance  attributes  are  feasible  to  precisely  and 
accurately  measure,  forms  the  foundation  for  determining  the 
performance  measures  and  ultimately  the  management  control 
system.  The  significance  of  identifying  the  proper  attri¬ 
butes  is  argued  by  Euske  when  he  says,  "apparently  well 
designed  systems  can  produce  undesired  results  because  of  a 
poor  choice  of  the  attributes  measured"  [Ref.  70]. 

Performance  measurement  provides  the  quantitative  and 
qualitative  information  that  is  needed  for  carrying  cut  all 
the  functions  of  a  ccntrcl  system  [Ref.  71].  Euske  advo¬ 
cates  a  five  step  plan  in  developing  the  system  for  perform¬ 
ance  measurement: 

a)  Identify  the  purpose  fer  the  measurement. 

b)  Identify  the  relevent  feasible  attributes  to  te  meas¬ 
ured. 

c)  Evaluate  the  measurements  in  terms  of  validity,  reli¬ 
ability  and  mearingf ulness. 

d)  If  the  evaluation  in  step  3  proves  inadequate,  develop 
a  new  system. 

e)  Evaluate  the  cost  and  relevance  of  the  measurement 
system. 

Three  terms  that  deserve  explanation  with  their  rele¬ 
vance  tc  measurement  are  meanfulness,  validity  and  reli¬ 
ability.  To  be  meaningful,  a  measurement  must  be 
understandable  from  the  perspective  cf  the  user  and  it  must 
not  exceed  the  limitations  cf  the  data  [Ref.  72].  Validity 
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deals  with  degree  of  similarity  between  the  relations  among 
the  numbers  chosen  tc  express  the  measurement  and  the  actual 
relations  of  the  quantities  measured  [Hef.  73].  Reliability 
relates  to  accuracy  in  the  sense  that  repeated  measurements 
display  consistency  when  measuring  the  same  attribute 
[Hef.  74]. 

Timeliness  of  information  is  also  a  significant  consid¬ 
eration.  "For  management  control,  data  must  be  available 
shortly  after  the  event"  (Hef.  75].  Timeliness,  in  this 
sense,  is  net  the  equivalent  cf  speed,  but  rather  is  related 
to  the  time  span  of  the  task.  "Shortly",  therefore  becomes 
a  timeframe  within  which  management  analysis  and  corrective 
actions  can  be  taken.  For  management  control  system 
purposes  a  timely,  but  less  accurate,  measurement  is  often 
preferable  to  an  accurate,  but  less  timely  measure 
[Ref.  76]. 

Hew  an  organization  measures  its  performance  is  as 
diverse  as  the  types  cf  organizations.  Tightly  coupled  with 
the  standards  of  performance,  the  measurements  of  perform¬ 
ance  often  involves  the  tedious  task  of  quantifying  a 
subjective  evaluation  of  performance.  If  indeed  it  is 
necessary  tc  do  so,  (ie,  when  using  the  computer  resource  tc 
accumulate  performance  data)  then  the  measurement  must  be 
free  from  factors  that  are  outside  the  control  of  the 
responsibility  center.  For  instance,  if  a  measurement  of 
programmer  performance  is  "quality",  then  the  term  quality 
should  be  defined  in  terms  that  reflect  the  actual  amount  of 
time  the  job  took  to  compile  or  job  run-time  once  it  was  in 
the  system  vice  job  turnaround  time  which  could  be  affected 
by  the  jcb  priority,  queueing  algorithm,  or  other "factors 
outside  of  the  pregrarame r ’ s  control.  The  measures  of 
performance  must  be  chosen  to  provide  prevention  rather  than 
correction  cf  deviations  to  the  greatest  extent  possible. 
Of  course,  the  single  most  important  aspect  of  measurement 
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is  that  it  must  be  capable  of  being  compared  to  the  stan¬ 
dards.  If  the  standards  and  measurements  are  net  compat¬ 
ible,  the  exercise  is  futile. 

I.  COMPARISON  OF  PERFORMANCE  TO  STANDARDS 

The  comparison  cf  performance  to  standards  is  made  to 
find  areas  in  which  the  achieved  output  is  not  consistent 
with  the  desired  output.  Mere  importantly,  the  comparison 
should  provide  an  indication  of  "why"  there  is  a  variance, 
its  impact  on  the  achievement  cf  the  goals,  and  what  correc¬ 
tive  action  should  be  taken  to  correct  the  discrepancy.  In 
the  comparison  and  evaluation  process,  the  manager  must 
ascertain  the  significance  of  the  variance  and  whether  the 
variance  is  a  result  of  temporary  conditions  or  the  result 
of  on-going  sub-standard  performance. 

Nith  standards  constructed  in  such  a  way  as  to  be  quan¬ 
tifiable  and  valid  measures  of  performance,  the  comparison 
is  reduced  to  a  relatively  simple  process.  The  difficult 
aspect  of  the  comparison  is  the  interpretation  and  evalua¬ 
tion  of  the  reported  data.  Regardless  of  how  quantitative 
the  results  of  the  comparison  are,  the  manager  must  make 
some  decision  on  whether  the  results  represent  a  real 
problem,  the  significance  of  the  variation,  and  how  best  to 
decide  what  to  do.  These  decisions  should  not  be  made  in  a 
vacuum  of  input.  The  comparison  should  be  the  catalyst  for 
the  manager  to  initiate  further  investigation.  This  inves¬ 
tigation  should  involve  those  persons  who  control  the 
performance  in  question  to  get  an  insight  as  to  the  possible 
causes  of  the  performance  variation  and  solicit  recommenda¬ 
tions  as  tc  how  to  resolve  the  problem.  When  the  persons 
responsible  for  meeting  the  performance  standards  are 
involved  in  the  setting  of  the  standards  and  collection, 
analysis,  interpretation,  and  evaluation  of  the  comparison 


data,  they  will  be  more  likely  to  be  committed  tc  meeting 
the  standards.  If  they  are  part  of  the  decision  process  on 
what  ccrrec*ive  actions  should  be  taken,  the  implementation 
cf  the  corrective  action  will  be  more  successful  than  an 
organizational  decree  from  the  •'boss'1. 

F.  P  BIO  Slim  TICS  OF  JOBS 

Of  the  many  resources  the  computer  center  manager  must 
optimize,  on?  of  the  must  critical  is  the  physical  utiliza¬ 
tion  of  the  computer.  Two  important  aspects  of  managing  the 
utilization  of  the  information  resource  is  controlling  of 
when  the  user's  jobs  arrive  at  the  computer  and  when  the 
jobs  are  run.  Axierod  [Ref.  77]  uses  the  terms  "macrose- 
guencing"  to  mean  "the  process  by  which  the  sequence  in 
which  jots  arrive  at  the  computer  center  is  effected"  and 
"micrcsequencir.g"  to  mean  "determine  the  sequence  in  which 
jobs  that  have  arrived  at  the  computer  center  fcr  service 
are  run." 

The  user  is  a  dominant  figure  in  the  management  of 
computing  resource  problems.  He  must  be  "induced  tc  use 
available  computing  facilities  in  a  manner  consistent  with 
the  organization's  objective  of  maximizing  the  net  value  of 
all  computer  jots  run.  This  objective  is  achieved  by 
central  control  through  the  use  cf  budgetary  control, 
pricing  rules,  and  priority  classification"  [Bef.  78],  The 
user's  budget  and  control  through  pricing  are  two  financial 
control  mechanisms  discussed  by  Axlerod  [Ref.  79], 

The  role  of  the  user  budget  in  computer  utilization  is 
to  induce  users  to  maximize  the  long-run  net  value  of  the 
computing  fcr  the  organization  as  a  whole  [Ref.  80],  "The 
user's  budget  determines  the  upper  limit  of  the  quantity  of 
computing  resources  that  can  be  purchased  subject  to  a  given 
price  and  priority  structures"  [Ref.  81].  when  the  user 
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population  is  outside  of  the  formal  data  center  organiza¬ 
tion,  the  quantity  cf  computing  resources  available  tc  the 
user  is  constrained  by  the  size  cf  the  user's  budget  and  the 
cost  cf  the  computing  service.  since  the  data  processing 
center  will  have  no  effect  on  the  user's  budget  size  the 
computer  center  manager  must  be  sensitive  to  the  effect  that 
the  cost  of  the  service  will  have  on  user  demand.  If  the 
user  is  in  the  internal  computer  center  organization,  the 
computer  center  manager  can  "manipulate  user  demands  by 
adjusting  the  total  user  budget  and/or  the  capacity  of  the 
facility"  (Ref.  82].  Budget  limitations  can  be  a  signifi¬ 
cant  factor  in  control  of  the  user's  demand  for  computing 
services.  Associated  with  the  budgetary  limitations  are  the 
effects  cn  demand  that  are  caused  by  the  prices  set  for 
computing  services. 

Axlerod  states  that  the  "primary  purpose  of  pricing  in 
(pricing  control)  is  its  role  in  allocating  the  demand  for 
computing  effectively."  The  pricing  scheme  must  be  made  in 
conjunction  with  the  characteristics  of  the  user's  budget. 
If  fcr  instance,  the  user  is  external  of  the  computer  orga¬ 
nization  with  a  fixed  computer  budget,  the  pricing  scheme 
must  take  into  account  if  the  user  has  a  choice  of  internal 
or  external  computing  services.  In  this  case,  market  prices 
may  well  dictate  the  pricing  scheme  the  Navy  computer  center 
uses.  Typically  user's  are  deterred  by  high  costs  cf  peak¬ 
load  services  in  a  peak-load  pricing  scheme.  This  illus¬ 
trates  the  processing  control  that  can  be  gained  ty  using 
varices  pricing  schemes.  Axlerod  [Ref.  83]  states  that  "the 
individual  user's  maximization  behavior  typically  will  lead 
to  subeptimizatien  cf  the  whole  system.  The  role  of  the 
controls  instigated  ty  central  control  is  to  induce  indi¬ 
vidual  users  to  maximize  the  utility  of  the  system  while 
maximizing  their  own  utilities,  subject  to  the  imposed 
constraints"  (Ref.  84]. 
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The  user  has  significant  impact  on  the  demand  cf 
computer  resources.  The  data  center  manager  car.  use  m-rv 
control  measures  to  regulate  the  demand  for  the  "scarce" 
computing  resource.  "Some  are  direct  rules  (e.g.,  certain 
lobs  may  he  restricted  to  given  times)  ;  some  are  less 
direct,  leaving  some  discretionary  power  in  the  hands  of 
users  (e.q.,  a  flexible  bud  get -pricing  scheme);  while  c+hers 
combine  direct  and  indirect  means  (e.g.,  a  priority-pricing 
scheme  may  combine  the  restrictiveness  of  priorities  with 
the  flexibility  of  pricing)"  [Ref.  85].  In  a  priority¬ 
pricing  scheme  different  priorities  are  charged  at  different 
rates.  "The  users  are  allowed  to  purchase  any  level  of 
priority  that  they  desire  and  can  afford.  Control  can  be 
applied  through  budgetary  manipulation  (if  user  is  within 
the  computer  center  organization),  variation  in  the  price- 
priority  relationships,  and  price  levels"  [Ref.  86], 
Sxlercd  proposes  that  the  "microsequencing"  process  can  be 
thought  cf  in  terms  cf  3  categories; 

a)  Time  Dependent  Jobs;  based  on  specific  time  parameters 
cf  the  computer  system,  such  as  the  arrival  times  of 
jobs  and  the  time  spent  awaiting  service.  Many  sched¬ 
uling  algorithms  (e.g.,  First-Come-First  Serve, 
Last-In-First-Cut,  Random  Service)  are  available  to 
data  center  managers  tc  optimize  resource  utilization 
when  job  values  can  be  determined. 

b)  Parameter  Dependent  Jobs;  "jobs  are  sequenced 
according  to  one  or  mere  of  their  physical  attributes, 
such  as  job  size,  job  type"  [Ref.  87].  Examples  of 
algorithms  to  deal  with  optimizing  these  types  of  jebs 
are; 

i)  Shortest-Job-Fi  rst ;  "of  jobs  in  queue,  the  job 
with  the  shortest  processing  time  is  the  first 
to  be  run  when  the  service  station  becomes 
available"  [Bef.  88]. 
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ii)  Longes  t-Job-Fir  st ;  "of  the  jobs  in  queue,  the 

job  with  the  longest  run  time  is  the  first  to  be 

run"  [Bef.  89]. 

c)  Value-Oriented  Jobs;  jobs  are  sequenced  according  to  a 
priority  assigned.  Axlerod  [Bef.  90]  proposes  four 
categories  of  value-oriented  jobs: 

a)  Priorities  based  on  job  value;  "the  net  value 
assigned  may  depend  on  tangible  parameters,  such 
as  the  mean  and  variance  of  the  turnaround-time 
distribution  and  it  may  include  more  obscure 
factors,  such  as  inconvenience  and  aggravation" 
[Bef.  91]. 

b)  Priorities  based  cn  user  status;  jobs  are  grouped 
into  categories  that  are  determined  by  the  type  of 
user  submitting  the  jcb.  For  instance,  in  a  Navy 
Supply  Center,  requisition  processing  may  have  a 
higher  priority  than  inventory  reordering. 

c)  Sequencing  with  preemption;  jobs  are  preempted  by 
c’-her  jobs  with  parameters  of  a  higher  priority. 

d)  Priced-based  sequencing;  the  user  is  allowed  to 
select  the  priority  cf  the.  job  where  the  higher 
priorities  are  available  at  higher  prices.  "The 
user’s  choice  of  priority  will  be  based  on  the 
priority/price  relationship,  (available)  funds, 
particular  service  needs,  and  the  state  of 
congestion  of  the  system"  [B9f.  92]. 

Fundamentally,  the  prioritization  control  problem  depends  on 
who  sets  the  priorities.  If  the  setting  of  oriorities  is 
performed  by  the  data  center  staff  or  an  au.^matic  sche¬ 
duler,  then  the  desired  control  mechanism  is  internal  to  the 
data  center  organization  and  the  goal  of  "maximizing  the  net 
value  of  all  computer  jobs"  [Bef.  93]  can  be  met  by  manipu¬ 
lating  internal  resources.  If,  however,  the  user  determines 
priorities,  a  pricing  scheme  must  be  used  to  control  the 
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resource  utilization.  Whatever  net hod  is  used,  priorities 
must  he  determined  and  cannot  be  left  to  chance.  The 
management  control  system  must  be  able  to  monitor  the  job 
prioritization  function  in  terms  of  hardware  performance 
(e.g.,  CPO  utilization  and  input/output  channel  utiliza¬ 
tion),  software  performance  (e.g.,  queue  length  and 

turna  round- time)  or  pricing  (e.g.,  job  billing  and 
accounting)  to  provide  the  data  center  manager  with  informa¬ 
tion  cn  the  physical  resource  utilization. 

G.  MANAGEMENT  HEPOB1S 

Cata  processing  management,  like  any  other  management, 
must  have  adequate  information  for  the  decision-making 
process  to  initiate  actions  tc  reach  the  organization's 
goals.  If  the  data  center  manager  wishes  to  direct  and 
control  the  activities  of  the  organization  and  benefit  from 
the  resources  of  the  computing  facility,  there  must  be  a  way 
tc  measure  performance  against  a  predetermined  level  of 
expectation  and  compare  resource  utilization  to  available 
capacity. 

Management  reports  provide  the  vechicle  for  such  ccmpar- 
isons.  Cn  the  basis  cf  management  reports,  managemnst  deci¬ 
sions  are  made  and  actions  are  taken  to  align  actual 
performance  to  expected  performance.  "  Viewed  from  this 
perspective,  management  reports  can  be  readily  accepted  as 
the  backbone  of  management  ccntrol”  [Ref.  94],  Schaeffer 
[Ref.  95]  suggest  tbere  are  three  questions  relevant  to 
obtaining  adequate  management  reports; 

1.  "What  information  should  be  included?  Information 
that  indicates  if  the  objectives  of  the  organization 
are  being  met  and  information  required  to  facilitate 
future  planning  should  be  included  in  the  performance 
reports. 
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2. 


"What  difficulties  should  be  cor.  side  r  si  ?"  An 
improvement  fcr  one  performance  standard  may  be  a~ 
the  expense  of  other  standards.  An  example  cit«d  by 
Schaeffer  (Ref.  96]  illustrates  how  a  reduction  of 
personnel  cost  may  look  favorable  from  the  perspec¬ 
tive  of  the  personnel  cost  standard,  but  in  reality 
the  cost  reduction  is  a  factor  of  personnel  turnover 
which  is,  of  course,  not  a  favorable  indication  at 
all.  A  second  difficulty  is  that  summary  statistics 
may  be  very  deceptive.  An  excellent  performance 
value  in  one  area  may  hide  pcor  performance  in 
another  area. 

"Bow  should  this  information  be  presented?"  To 
provide  a  comprehensive  view  of  organizational 
performance,  the  reports  should  have  the  following 
characteristics: 

a)  The  reporting  system  should  measure  and  evaluate 
all  functions  that  contribute  to  attainment  of  the 
organizaticnal  goal. 

b)  The  reports  should  be  tailored  to  specific  func¬ 
tions  and  express  performance  in  terms  appropriate 
tc  that  function. 

c)  The  reports  should  contrast  related  measures  of 

performance  in  such  a  manner  that  may  indicate 
cause  and  effect  relationships.  Schaeffer 

[Ref.  97]  recommends  the  use  of  ratios  tc  "stress 
the  changing  relationship  between  two  factors  that 
would  not  be  apparent  in  isolated  entries." 

d)  The  reports  should  be  clear  and  concise.  Summary 
reports  should  be  used  where  appropriate  and 
reports  to  higher  level  management  should  he  in 
graphic  form. 

e)  The  reports  should  measure  performance  against  a 
predetermined  standard. 
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f)  The  report  timeframe  should  be  broad  enough  to 
provide  a  historical  background  on  which  to  base 
judgements  cf  the  performance. 

g)  The  reports  should  address  resource  utilization 
versus  available  capacity. 

h)  The  reports  should  be  prepared  in  an  appropriate 
periodicity  to  allow  timely  corrective  action. 

i)  The  reports  shculd  provide  management  with 
performance  information  to  draw  inferences  on 
potential  problems. 

j)  The  reports  should  facilitate  trend  analysis  for 
organizational  planning. 

The  underlying  theme  of  the  previous  management  report  char¬ 
acteristics  is  the  organization's  ability  to  measure 
specific  outputs,  and/or  performance  measurements.  The 
absence  cf  these  concrete  measures  requires  some  measure  of 
the  "proper  behavior"  of  the  members  of  the  organization. 

As  previously  mentioned,  there  can  be  seme  organizatinal 
hierarchy  considerations  in  the  evaluation  of  performance. 
In  addition  to  the  traditional  vertical  hierarchial  struc¬ 
ture,  there  is  also  a  horizontal  structure  of  information 
flow  [Bef.  98].  Since  all  organizational  groups  may  not 
have  access  to  relevant  performance  information,  this  hori¬ 
zontal  flow  of  management  reports  must  be  accomodated. 
Thompson  [Bef.  99]  describes  three  types  of  task  interdepen¬ 
dence  that  influences  the  physical  and  organizational 
aspects  of  a  computing  facility's  information  processing 
technology: 

1.  Pooled;  each  group  of  the  organization  makes  a 
discrete  contribution  to  the  system  while  acting 
relatively  independent  of  one  another.  For  example, 
an  analyst  working  in  the  inventory  application  of 
the  Uniform  Automated  Data  Processing  System  (OADPS) 
evaluates  and  modifies  this  application  independent 
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of  what  other  analysts  may  be  icing  in  another  ’JADPS 
applications. 

Sequential;  cne  organizational  group  may  generate 
outputs  for  use  by  one  or  many  other  organizational 
groups. 

3.  Reciprocal;  tasks  mutually  interact.  For  example,  an 
inventory  control  department  generates  a  report  iden¬ 
tifying  purchase  request  that  are  late  being 
processed.  This  will  key  the  purchasing  department 
tc  follow-up  and  expedite  purchasing  action  on  the 
late  requests. 

In  the  vertical  flow  of  management  report  information  there 
are  four  organization  levels: 

1.  Operating  personnel  who  generate  and  distribute  the 
management  reports. 

2.  Operating  managers  whose  functional  responsibilities 
include  monitoring,  controlling,  and  directing  the 
performance  of  their  respective  groups. 

3.  Data  processing  manager  who  acts  as  the  computer 
center  manager. 

4.  Commanding  Officer*  (cr  top  management)  who  is 
responsible  fcr  directing  and  controlling  the  data 
center’s  integration  into  the  overall  organization. 

Each  organizational  level  needs  management  reports.  Seme 
management  reports  are  common  to  all  four  organizational 
levels  and  some  are  explicitly  appropriate  for  an  individual 
organizational  level.  The  reports  appropriate  fcr  each 
level  will  be  discussed  in  more  detail  Chapter  4. 


^Commanding  Officer  and  data  processing  manager  may  be 
the  same  individual  in  some  organizations. 
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B.  CORRECTIVE  ACTIO  E 


Once  the  comparison  and  evaluation  of  actual  performance 
to  expected  performance  is  made,  the  appropriate  organize- 
tional  level  must  decide  whether  or  not  any  action  is  neces¬ 
sary.  If  actions  is  deemed  necessary,  it  occurs  in  either  a 
corrective  action  form  or  in  the  modification  of  either 
goals,  standards  or  measurements  of  performance.  Webber 
[Ref.  100]  suggests  that  ’'management  compares  the  expected 
and  actual  performance  in  order  to  decide  about  its  status: 

1.  "Performance  is  in  control;  no  action  is  necessary. 

2.  Performance  is  not  in  control;  take  corrective  action 

3.  Performance  is  less  than  expected,  but  efforts  seem 
satisfactory;  investigate  validity  of  the  goals  and 
modify  them  as  necessary." 

If  corrective  action  or  review  of  the  goals  and  objec¬ 
tives  are  deemed  appropriate,  the  manager  must  provide  feed¬ 
back  to  those  components  of  the  organization  whose 
performance  does  not  meet  the  expected  standards.  Where 
corrective  actions  is  required,  the  feedback  should  be  as 
timely  as  the  performance  monitoring  process  so  that  the 
corrective  action  can  be  initiated  early.  A  pitfall  associ¬ 
ated  with  early  feedback  is  what  Webber  [Ref.  101]  refers  to 
as  "premature  rapid  response".  The  premature  rapid  response 
situation  can  occur  when  the  measurement  of  performance  is 
not  a  valid  indicator  of  performance  or  the  periodicity  of 
the  report  is  out  of  synchronization  with  the  appropriate 
timeframe  of  the  performance  being  measured.  The  conditions 
in  which  performance  is  measured  must  be  defined.  Unique 
timeframes  and  consideration  for  a  certain  set  of  conditions 
must  be  taken  into  account.  For  instance,  if  interactive 
terminal  response  time  is  measured  during  a  period  of  high 
batch  activity,  the  response  time  performance  may  well  be 
below  the  standard.  If  the  manager  is  not  aware  of  the 
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environment  in  which  the  performance  is  measured,  a  prema¬ 
ture  response  that  directs  corrective  action  may  exacerbate 
the  eveiali  system  performance.  The  desire  for  a  timely 
correction  cf  a  variance  and  a  decision  to  wait  for  further 
indication  cf  problems  must  be  balanced  to  avoid  the  over- 
reaction  syndrome  [Hef.  102]. 


IV.  31  DEVELOPING  4  CONTROL  SX£SI3 


The  management  control  system  must  be  developed  and 
maintained  in  an  environment  of  adaptability  *0  change.  It 
bus-*:  be  adaptive  to  the  rapid  advances  in  hardware  and  soft¬ 
ware  technology  and  account  for  the  dynamic  growth  in  the 
r.ew  program  applications.  The  management  control  system 
must  te  the  common  denominator  ir.  evaluating  the  organiza¬ 
tion’s  progress  toward  achieving  its  goals  and  objectives 
and  west  take  into  account  the  coordination  of  resources 
external  and  internal  to  the  organization.  It  must  be  set 
in  a  regulatory  role,  but  at  the  same  time  be  sensitive  to 
the  external  factors,  such  as  commercial  competition,  migra¬ 
tion  cf  skilled  computer  labor,  and  increasing  user  demand. 

1.  ESTAELISH  GOALS  AID  OBJECTIVES 

The  mechanism  for  making  the  organization’s  dreams  and 
strategic  plans  meaningful  to  its  personnel  is  the  estab¬ 
lishment  and  communication  of  its  objectives.  These  objec¬ 
tives  can  be  formulated  in  two  categories;  operational 
objectives  and  organizational  objectives.  The  similarities 
between  these  ‘wo  categories  is  in  the  overall  goal  of  an 
optimum  blend  of  efficiency  ar.d  effectiveness. 

Anthcny  [Ref.  103]  distinguishes  between  goals  and 
objectives  in  the  following  manner: 

1.  Gcals;  "a  statement  of  intended  output  in  the 

broadest  terms.  It  is  normally  not  related  to  a 
specific  time  period.  The  purpose  of  a  statement  of 
goals  is  to  communicate  top  management’s  decisions 
about  the  aims  and  relative  priorities  of  the  organi¬ 
zation  and  provide  general  guidance  as  to  the 
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strategy  that  the  organization  is  to  follow.'*  The 
goals  should  he  stated  as  precisely  as  possible  and 
only  those  predominant  goals  that  are  critical  to  the 
organization  should  be  formalized.  Anthony's 

(Bef.  104]  stated  purpose  of  goals,  ”...  to  communi¬ 
cate  top  management's  decision  about  the  aims...”, 
seems  to  imply  that  the  goals  are  set  solely  by  top 
management.  Effective  goal-setting  should  include  an 
input  from  all  levels  of  the  organization.  If  the 
various  levels  of  an  organization  are  in  agreement 
with  the  stated  organizational  goals,  an  important 
criteria  cf  goal  realization  (i.e.,  goal  congruency) 
is  attained.  "Formally,  goals  originate  from  top 
level  management  and  are  influenced  by  the  environ¬ 
ment,  but  also  goals  are  made  all  through  the  system, 
even  to  the  bottom"  (Bef.  105]. 

2.  Ctjectives;  "a  specific  result  to  be  achieved  within 
a  specified  tine,  usually  one  year  or  a  few  years. 
If  feasible,  an  objective  should  be  stated  in  measur¬ 
able  terms.  An  objective  should  be  consistent  with 
the  goals  of  the  organization.”  Anthony  (Ref.  106] 
asserts  that  the  statement  of  objectives  is  essential 
tc  the  management  control  system  because  "an  organi¬ 
zation's  effectiveness  can  be  measured  only  if  actual 
outputs  are  related  to  objectives." 

There  is  a  hierarchy  cf  goals  that  corresponds  closely  to  an 
organizational  hierarchy.  For  instance,  the  command  goal 
may  he  segregated  into  departmental  goals  that  represent 
departmental  expectations  and  contributions  to  the  overall 
organizational  goal.  Likewise,  organizational  objectives 
can  be  supported  by  individual  departmental  objectives. 
Using  Anthony's  (Ref.  107]  framework,  here  are  some  examples 
of  data  processing  center  goals  and  objectives: 
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1.  COMMAND  GENERAL  GO&1  .1 .  Increase  productivity  and 
ccst  effectiveness. 

a)  Departmental  specific  goal  1  -60-3 ;  Improve 

statistical  data  gathering  capabilities. 

i)  Objectives; 

•  Develop/obtain  software  by  1  September 
1984  to  provide  computer  system  statis¬ 
tical  data. 

•  Refine  capacity  analysis  report  system 
techniques  by  1  October  1984. 

b)  Department  specific  goal  1-60-4:  Reduce  computer 

re-run  time. 

i)  Objectives; 

•  Increase  operator  training  {data  entry)  to 
once  a  week. 

•  Increase  number  of  applications  run  under 
automatic  scheduler. 

B.  SET  POLICIES  AND  EBOCEDOBBS 

Once  the  specific  goals  and  objectives  have  been  formal¬ 
ized,  the  next  step  is  to  state  in  general  terms  top  manage¬ 
ment’s  policy  with  regards  to  how  to  achieve  those  goals  and 
objectives.  Again  a  hierarchial  flow  of  policy  statements 
should  eirerge  that  are  congruent  and  provide  guidance  to 
each  subordinate  level  in  the  organization.  Likewise, 
subordinate  levels  of  management  should  make  policy  for 
levels  of  crganizaticn  within  their  group.  The  construction 
cf  the  policy  structure  must  be  supportive  of  the  plans  to 
achieve  the  goals  cf  the  organization  and  the  policies 
should  address  the  course  of  action  each  level  of  the  organ- 
izaicn  should  take  tc  attain  the  appropriate  objectives. 

At  each  level  cf  the  organization  the  policies  are 
refined  to  specific  procedures.  The  procedures  generally 


state  how  the  expectations  cf  the  organization  car.  be  a  --  by 
detailing  those  specific  actions  that  must  be  taken  at  ar. 
appropriate  level  in  the  organization.  For  instance,  a 
policy  for  the  irput/cutput  branch  is  to  control  job  receipt 
and  disbcrsements.  The  procedure  for  accomplishing  this 
control  may  be  to  reguire  positive  identification  by  photo¬ 
graph  and  signatures  of  users  receiving  completed  jobs.  As 
can  be  seen  from  the  preceding  example,  the  management 
control  process  permeates  the  organization  and  operates  on  a 
continuum  that  starts  with  the  definition  of  goals  and 
objectives  and  proceeds  to  the  development  of  specific 
actions  tc  accomplish  those  goals. 

C.  ORGANIZATION AL  STBUCT0R1  ABO  THE  CONTROL  SYSTEM 

At  the  heart  of  the  management  control  system  is  it's 
relationship  with  the  organizational  structure.  The  manage¬ 
ment  control  system  will  have  a  different  role  in  the  orga¬ 
nization  depending  on  whether  the  organization  is 
centralized  or  decentralized.  There  are  many  arguments 
fRef.  108]  for  both  a  centralized  or  decentralized  data 
processing  organization.  Martin  [Ref.  109]  lists  the 
following  arguments  relating  to  the  centralization/ 
decentralization  questions: 

1.  "Total  Costs 

2.  Technical  arguments  ether  than  costs 

3.  Arguments  relating  to  application  development 

4.  Arguments  relating  to  which  applications  should  be 
centralized  and  which  decentralized 

5.  Arguments  involving  (organizational)  politics,  the 
behavior  of  cf  people,  or  the  impact  on  the  human 
side  of  the  (organization)." 

Martin  also  states  [Bef.  110]  that  "the  best  of  both  worlds 
can  be  achieved  by  a  judicious  mixture  of  centralized  and 
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decentralized  functions."  The  key  to  management  control 
system's  role  in  a  centralized,  or  decentralized  oraaniza- 
tion  is  whether  operational  data  is  available  to  compare  the 
actual  performance  tc  the  planned  performance.  This  opera¬ 
tional  data,  usually  available  as  management  reports,  is  the 
encapsulation  of  the  ether  elements  in  a  control  system. 

Figure  4.1,  a  modified  version  of  a  Boore  and  Murphy 
model  [Ref.  Ill],  illustrates  the  concept  where  decentral¬ 
ized  units  input  operational  data  into  a  data  base  from 
which  management  reports  can  be  extracted  for  the  management 


Management  has  age ess  to  operational  information 
without  interfering  with  daily  operations.  Computer 
can  process,  analyze,  interpret  and  evaluate  key 
operations  and  produce  routine  or  exception  reports, 
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Figure  4.1  Use  of  Data  by  Management  and  Decentralized  Units. 
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control  system.  This  model,  of  coarse,  assumes  tha*  the 
central  computer  resource  and  decentralized  units  are  hard¬ 
ware  and  software  compatible,  ie.,  the  files  of  the  decen¬ 
tralized  units  are  structured  as  subschemas  cf  the 

\ 

centralized  data  base. 

Since  operatinal  data  is  accessible  to  top  management  by 
data  base  query,  seme  workers  may  fear  that  the  data  they 
input  can  be  used  to  rate  their  personal  performance.  This 
could  lead  to  a  phenomenon  where  the  input  data  may  be  exag¬ 
gerated  toward  more  favorable  figures.  Additionally,  seme 
personnel  cr  departments  may  be  reluctant  to  share  their 
oprational  secrets  cr  developments  with  other  grouups  that 
could  have  access  to  their  data.  The  key  to  this  problem  is 
for  the  appropriate  groups  to  have  access  to  the  same 
reports  as  top  level  management  in  their  respective  area. 
Ir.  this  way,  the  lower  echelcn  levels  can  have  the  same  data 
and  can  be  taking  corrective  action  or  be  prepared  to 
discuss  variances  when  the  upper  levels  have  questions  about 
them.  Regardless  of  the  organizational  structure,  opera¬ 
tional  information  must  must  be  available  to  the  management 
control  system. 

D.  SIT  STANDARDS 

Cnee  the  organizational  goals  and  objectives  are  formal¬ 
ized,  a  set  of  standards  is  developed  to  foster  the  attain¬ 
ment  of  these  objectives.  As  previously  defined,  Cuchi 
[Ref.  112]  suggests  that  an  organization’s  control  mechanism 
will  be  made  up  of  a  combination  of  a  pure  market,  a  pure 
bureaucracy,  and  a  pure  clan.  Additionally,  the  organiza¬ 
tion  will  contain  some  features  of  each  mode  of  control.  In 
designing  standards  the  computer  center  manager  must  assess 
the  secial  and  informational  characteristics  of  each  level 
cf  the  organization  and  determine  which  form  of  control 


should  be  used  in  each  case.  Cuchi  [Ref.  113]  suggests  that 
the  sccial  characteristics  involve  such  requirements  as: 

1.  1.  flcrm  of  reciprocity 

2.  2.  legitimate  authority 

3.  3.  Shared  values  and  benefits 

The  informational  characteristics  that  are  keyed  to  the  type 
of  control  are  explicitly  stated  and  maintained  intention¬ 
ally  at  some  cost.  The  informational  characteristics 
include;  prices,  rules,  and  traditions. 

Brandon  [Ref.  110]  refers  to  standards  as  "performance 
standards"  and  defines  them  as  "yardsticks",  standards  are 
used  to  measure  the  performance  of  the  data  processing  func¬ 
tion"  [Ref.  115].  Essentially,  standards  are  "what  should 
he  accomplished  (to  achieve  organizational  objectives)  "  and 
"expectations  by  which  satisfactory  performance  can  be 
judged"  [Ref.  116],  The  standards  must  be  valid  character¬ 
istics  of  the  organization  and  be  of  some  use  in  monitoring 
the  progress  toward  the  organizational  goal. 

according  to  Schaeffer  [Ref.  117],  standards  address  the 
following  questions  concerning  the  organizational  objec¬ 
tives  : 

1.  "How  will  attainment  of  data  center  objectives  be 
judged? " 

2.  "How  will  the  data  center  be  structured  to  meet  these 
oh  jectives?" 

3.  "How  will  adequacy  of  personnel  career  paths  be 
judged?" 

4.  "How  will  adeguate  career  paths  be  established?" 

5.  "How  will  effective  budgeting  be  judged?" 

6.  "How  will  the  budgeting  be  done?" 

The  development  of  the  standards  should  be  done  in  an  crder 
cf  precedency  with  the  most  important  and  urgent  standards 
developed  first.  Typically,  organizational  structure  stan¬ 
dards  are  logically  the  first  ones  developed  to  provide  a 


framework  for  evaluation  of  the  functions  and  workflow  of 
the  organization.  Standards  should  be  constructed  in  such  a 
manner  that  not  only  provides  empirical  data  but  also  facil¬ 
itates  analysis  in  terms  of  patterns,  trends  and  indicators. 

Schaeffer  [Ref.  118]  has  classified  standards  into  four 
general  categories: 

1.  "Administrative  standards;  includes  activity  and 
perfcrmance  reporting  requirements. 

2.  Operations  standards;  includes  workstation,  workflow 
and  cata  center  perfcrmance. 

3.  Contingency  standards;  attends  to  varying  degrees  of 
emergencies  including  disaster  plans. 

4.  Support  service  standards;  includes  data  center  relo¬ 
cation,  equipment  selection  and  documentation." 

These  classes  of  standards  must  address  a  variety  of  organi¬ 
zational  issues.  The  standards  must  attempt  to  support  the 
unique  data  processing  objectives  of  the  organization 
mentioned  earlier,  and  also  support  the  "continuing  objec¬ 
tives  for  all  organizations"  identified  by  Webber  [Ref.  119] 
These  continuing  objectives  include: 

1.  Identification;  "achieving  staff  consensus  and 
committment  to  organizational  objectives." 

2.  Integration;  "an  overlap  between  personnel's  personal 
objectives  and  the  (organization's)." 

3.  Social  influence;  "a  distribution  of  power  and  influ¬ 
ence." 

4.  Collaboration;  "a  means  of  measuring  human  conflict 
within  the  organization." 

5.  Adaptation;  "a  monitoring  of  the  external  environment 
and  responding  appropriately  internally." 

6.  Revitalization;  "a  development  of  personnel  vitality 
and  creativity." 

The  standards  must  be  clear,  concise,  complete  and  well 
documented.  The  users  must  be  involved  in  establishing  and 
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later  evaluating  the  standards-so  that  the  users  understand 
not  only  the  standards  but  also  the  logic  for  monitoring 
performance  in  that  way.  Failure  to  involve  users  in  stan¬ 
dard  development  may  result  in  user  dissatisf aczicn  and 
cause  a  duplication  of  the  standards  development  effort. 
User  involvement  in  standards  formulation  will  result  in  the 
selection  of  standards  in  such  a  way  as  to  preclude  intro¬ 
duction  of  variances  that  are  beyond  the  control  of  the 
respcnsitle  center.  There  must  be  agreement  between  all 
levels  of  the  data  center  organization  and  the  users  that 
the  standards  set: 

1.  Supports  the  attainment  of  organizational  objectives 

2.  Are  fair  "yardsticks”  to  gauge  the  attainment  of  the 
objectives 

3.  Are  valid  indicators  of  the  organization's  objectives 

E.  DETERMINE  HEASUBES  OF  PE8F0BMANCE 

The  question  of  hew  to  measure  performance  is  a  complex 
one.  The  data  center  manager  has  to  not  only  measure  the 
performance  of  highly  technical  equipment,  but  also  the 
performance  of  personnel  and  the  degree  to  which  the  organi¬ 
zational  structure  supports  the  equipment  and  personnel. 
The  measures  of  performance  must  address  not  only  those 
parameters  that  can  be  measured  quantitatively,  but  also 
those  that  must  be  assessed  on  a  subjective  basis. 

Metrics,  the  measures  by  which  things  are  evaluated,  are 
relatively  straightforward  for  quantifiable  characteristics 
but  net  so  accurate  for  qualitative  areas.  The  metrics  must 
be  accurate,  readily  available,  consistent,  impartial  and 
congruent  with  performance  standards.  The  complexity  of 
measuring  performance  is  evident  in  the  general  purpose 
nature  of  the  computer  center  operation.  A  Navy  computer 
center  will  typically  run  more  than  one  type  of  application 
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and  determining  the  measures  cf  performance  to  use  for  the 
hardware  alone  is  difficult.  For  instance,  should  the 
performance  measure  fce  in  terms  cf  number  of  jcbs  processed? 
This  ignores  the  problem  of  differential  loads  that  various 
jobs  place  on  the  systems.  The  system  resource  utilization 
can  be  an  altenative  measure,  but  at  times  some  of  the 
systems  resources  have  a  higher  utilization  than  others. 
The  answer  to  the  question  of  what  performance  parameters  to 
evaluate  must  be  made  with  inputs  from  all  levels  of  the 
organization.  Shat  standards  of  performance  are  selected, 
how  the  organization  is  structured,  whether  the  performance 
information  can  be  collected,  the  costs  and  benefits  of 
collecting  the  performance  data,  and  whether  or  net  meas¬ 
uring  these  performance  parameters  is  useful  in  controlling 
the  information  resource  (equipment,  facilities,  and 
personnel)  must  all  be  considered. 

Quantifiable  monitoring  of  the  computer  system  perform-, 
ance  can  help  isolate  the  portion  of  th  system  that  is  oper¬ 
ating  below  performance  standards.  some  primary  tools  for 
collecting  system  performance  data  are: 

1.  Operating  system  accounting  packages.  These  software 
tcols  are  very  capable  in  terms  of  collecting  system 
performance  but  generally  require  additional  overhead 
in  terms  of  memory  capacity. 

2.  Hardware  monitors.  Hardware  monitors  are  userful  in 
collecting  performance  data  such  as  voltage  fluctua¬ 
tions,  hardware  mechanical  availability  and  hardware 
response  times. 

3.  Software  monitors.  Software  monitors  are  usually 
composed  of  two  elements;  one  which  collects  pregram 
performance  data  and  another  that  analyzes  and 
reports  the  performance  data. 

4.  Embedded  system  monitors.  Data  collection  and 
reporting  modules  are  designed  into  the  applications. 
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Some  quantitative  system  performance  measures  that  may  te  of 
value  to  the  various  levels  of  the  data  center  management 
are  listed  below: 

1.  Terminal  response  time 

2.  Transctions  processed 

3.  Percentage  of  system  availability 

4.  Records  processed 

5.  Reports  delivered 

6.  communication  line  loading 

7.  CPU  utilization  versus  availability 

8.  Number  of  program  re-runs 

Some  quantitative  organizational  performance  measures  that 
may  be  of  value  are: 

1.  Budget  reports 

2.  Overtime/staffing  reports 

3.  System  maintenance  backlog 

4.  Training  reports 

The  preceding  reports  can  be  categorized  as  budgetary,  plan¬ 
ning,  resource  utilization  and  allocation,  and  performance 
control  reports. 

Qualitative  measures  are  more  difficult  to  establish. 
In  many  cases  qualitative  measures  of  performance  rely  on 
subjective  evaluation.  Although  there  are  many  quantitative 
models  to  define  reliability  and  productivity,  users  gener¬ 
ally  address  reliability,  usability,  adaptiveness,  produc¬ 
tivity,  effectiveness  and  innovation  in  qualitative  terms. 
As  Ouchi  [Bet.  120]  contends,  the  degree  of  qualitative  or 
quantitative  form  of  measurement  involved  in  the  definition 
cf  these  types  of  terms  will  depend  on  the  organization's 
technological  sophistication  and  actual  ability  to  measure 
attributes.  Even  when  these  terms  are  qualitative  in  nature 
and  they  can  be  correctly  labelled  vague  and/or  subject  to 
ambiguity;  the  constraints  cf  the  systems  inability  to 
provide  more  accurate  or  quantitatively  measurable  attri¬ 
butes  dictate  their  utility. 
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A  data  processing  center  typically  operates  as  a  service 
crganizaticn  and  as  such  is  often  constrained,  at  least  in 
part,  tc  qualitative  evaluations  based  on  user  perceptions. 
The  following  computer  service  characteristics,  although 
difficult  tc  measure,  will  provide  the  user's  perception  of 
how  well  the  data  processing  meets  the  user's  needs 
[Ref.  121]. 

1.  service  usefulness;  Does  service  provide  data 
required  for  user  operations? 

2.  Service  responsiveness;  Is  service  performed  in  spec¬ 
ified  tiaefrate? 

3.  Service  flexibility;  Are  unexpected  requirements 

accomodated  in  a  timely  manner? 

«.  Service  availability;  Is  service  available  when  users 
need  it? 

5.  Service  reliability;  Does  service  provide  correct 
irformaticn  in  correct  format? 

6.  Data  processing  canter  involvement  in  user  require¬ 
ments  development;  Is  data  processing  center  involved 
in  establishing  user  data  processing  requirements? 

7.  Data  processing  center  system  maintenance  support; 
Dees  data  processing  center  provide  timely  hardware 
and  software  maintenance  support? 

8.  Data  center  support  of  user's  objectives;  Does  the 
data  processing  center  understand  and  support  the 
user's  objectives. 

These  quality  of  service  measurements  are  generally  provided 
by  the  user  satisfaction  surveys.  The  information  provided 
is  often  formulated  on  the  user's  perception  of  the  service 
rather  than  statistical  data. 

The  measurements  of  performance  for  the  organization 
should  net  be  limited  to  only  budgetary  items  but  should 
also  include;  organizational  resources,  such  as  personnel 
and  communications;  computing  resources,  such  as  CPU  and 
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peripherals;  administrative  resources,  such  as  clerical  arc 
reports;  and  managerial  resources,  such  as  lcng-ranqe  plans 
and  investments. 

f.  COMPARISON  OF  PEBFCBHAHCE  TO  STANDARDS 

Once  a  mechanism  has  been  established  to  collect  the 
appropriate  measures  of  performance  and  the  performance  data 
is  collected,  it  must  be  compared  to  the  respective  perform¬ 
ance  standards.  This  comparison  is  a  three  step  process: 

1.  Analysis;  a  separation  of  the  performance  data  into 
its  parts  to  study  its  structure. 

2.  Interpretation;  a  definition  of  the  meaning  of  the 
performance  data. 

3.  Evaluation;  the  assessment  of  the  actual  operational 
and  managerial  conditions  as  compared  to  the  expected 
performance  set  forth  in  the  standards. 

The  comparison  cf  performance  to  the  desired  standards 
should  be  done  to  determine  the  variance  between  actual  and 
planned  performance.  The  performance  should  be  evaluated  to 
analyze  trend  data  and  to  compare  relative  change  vice  abso¬ 
lute  change.  Vital  to  the  comparison  process  is  the  accu¬ 
rate  recording  of  the  performance  data.  The  standards  must 
be  set  at  a  level  that  is  reasonably  attainable.  The  bottom 
line  comes  in  the  evaluation  of  the  comparison  data.  If 
must  be  viewed  in  tie  context  cf  the  accomplishment  of  the 
crganizaticnal  objectives  and  the  comparison  process  itself 
must  be  reviewed  to  ensure  that  the  control  system  is  moni¬ 
toring  those  vital  signs  of  the  organization's  activities 
that  are  in  the  mainstream  of  its  future.  The  results  of 
the  comparison  must  then  be  a  source  of  feedback  for  what¬ 
ever  corrective  action  is  needed. 

Where  in  the  organizational  structure  the  comparison  of 
performance  to  standards  is  made  is  determined  by  the  reia- 
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tive  hierarchy  of  the  measure  cf  performance.  For  instance, 
if  a  measure  of  performance  is  "program  re-runs  due  to  oper¬ 
ator  error",  the  shift  supervisor  would  be  a  mere  appro¬ 
priate  individual  to  monitor  that  particular  performance 
criteria  than  the  data  center  manager.  Conversely,  the 
trend  data  concerning  the  proliferation  cf  new  user  applica¬ 
tions  is  mere  appropriately  monitored  at  the  data  center 
manager  level.  The  evaluation  of  the  management  control 
system's  monitoring  cf  performance  must  not  be  strictly  a 
top  management  responsibility.  When  the  standards  are  set 
and  the  measures  of  performance  defined,  the  analysis, 
interpretation  and  evaluation  of  the  performance  measures 
should  be  done  by  persons  or  groups  of  persons  who  can 
directly  cr  indirectly  influence  the  behavior  of  that 
particular  performance.  It  may  be  appropriate  that  many 
crganizaticnal  levels  monitor  specific  performance  measures. 
Computer  program  backlog  is  an  example  of  a  performance 
measurement  that  permeates  all  levels  of  a  data  center  orga¬ 
nization.  Likewise,  customer  complaint  trends  affect  the 
entire  data  center  organization. 

6.  H AHAGE81NT  HBPOHIS 

The  primary  objective  of  management  reports  is  to 
provide  the  top  level  cf  organizational  management  with  the 
information  necessary  to  direct  and  control  the  activities 
of  the  data  processing  center  in  its  contribution  to  the 
cverall  gcals  and  objectives  of  the  organization.  The 
management  reports  tc  top  management  must  provide  informa¬ 
tion  in  the  following  broad  categories: 

1.  Existing  problems  and  risks 

2.  Potential  problems  and  risks 

3.  Accountability  for  each  function,  decision  and 
project 
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4.  Corrective  actions. 


in  progress  or  planned. 


to  deal 


with  existing  or  potential  problems 

5.  Variances  in  meeting  or  exceeding  performance  stan¬ 
dards 

6.  Benefits  resulting  from  individual  or  group  perform¬ 
ance  or  decisions 

These  types  of  information  should  be  presented  to  top  level 
management  in  summary  .form,  such  as  graphics,  but  with  a 
clear,  concise  narrative  that  highlights  the  major  points  of 
interest  in  specific  areas. 

For  discussion  purposes,  the  organizational  structure  of 
a  Navy  computer  center  is  assumed  to  be  one  in  which  there 
is  a  Naval  Officer  assigned  as  Commanding  Officer  (repre¬ 
senting  top  management)  to  whom  the  data  center  manager, 
either  civilian  or  military,  reports.  Reporting  to  the  data 
center  manager  are  departmental  managers  and  organizatio- 
nallly  below  the  departmental  managers  are  the  operating 
personnel,  with  this  organizational  structure,  the  types  of 
management  reports  will  in  some  cases  be  the  same  (i.e.,  CPU 
utilization).  But  in  other  cases,  the  management  reports 
will  concentrate  on  the  performance  parameters  appropriate 
to  the  specific  level  of  responsibility  and  that  organiza¬ 
tional  level. 

The  following  management  reports  should  be  submitted  to 
the  Commanding  Officer,  addressing  the  six  information 
categories  previously  discussed: 

1.  Budget  Report s. 

Budget  reports  should  display  to  the  commanding 
Officer  a  comparison  of  actual  expenditures3  to 
planned  expenditures  for  the  work  accomplished  for 
the  data  processing  department  and  overall  organiza- 


3Expenditures  in  this  sense  relates  only  to  the  concept 
cf  spending  resources  and  dees  net  make  distinctions  between 
obligations  and  expenses  as  defined  by  the  Resource 
Management  System  (RMS)  accounting  practices. 
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tier..  Narrative  comments  should  be  provided  to 
discuss  reasons  for  trends  and  variances.  Budger 
reports  should  show  departmental  budget  status  with 
comments  explaining  any  variances. 

2.  Resource  Utilization  Retorts 

a)  Operations 

i)  Available  CPU  capacity  versus  capacity 

acutally  used.  This  report  should  compare 
available  CPO  capacity  with  how  the  CPU  was 
actually  used  by  categories  (e.g.,  running 
programs,  downtime,  reruns,  preventive  and 
remedial  maintenance,  and  application  devel¬ 
opment)  . 

ii)  Available  storage  capacity  versus  storage 
capacity  used. 

iii)  Available  data  entry  capacity  versus 

capacity  used. 

iv)  overtime  or  extraordinary  staffing  require¬ 
ments.  This  report  will  give  indications  of 
reaching  staffing  capacity  limits  and  need 
for  additional  staff. 

v)  General  comments  on  potential  capacity  litri- 
tatiens  (hardware  and  personnel)  and  recom¬ 
mendations  for  change  to  increase 
organizational  efficiency  and  effectiveness. 

b)  system  Development  and  Maintenance 

i)  Backlog  of  system  maintenance,  new  service 
requests  and  modification  requests.  The 
backlog  should  indicate  by  type  of  request 
the  man-hours  that  will  be  needed  to  bring 
service  requests  to  a  current  status.  The 
average  age  of  the  requests  should  be  indi¬ 
cated  with  the  percentage  of  system  mainte¬ 
nance  staff  that  will  be  needed  and  the 
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predicted  date  that  the  backlog  will  be 
eliminated. 

ii)  Status  of  major  projects  indicating  current 
status,  progress  and  problems. 

Perform an ce  Ccrtrol  Reccrts 

a)  Operations 

i)  Cost  cf  recovery,  CPU  time  and  number  of 

re-runs.  This  should  be  compared  to  the 
performance  standard  with  comments  to 
explain  causes  and  corrective  actions  taken. 

ii)  On-line  system  response  time.  This  should 

be  a  comparison  of  actual  (averaged) 

response  time  to  a  predetermined  standard. 
This  report  also  gives  an  indication  of 
support  to  the  on-line  users. 

iii)  late  reports.  This  is  an  indication  of  how 
many  reports  were  delivered  on  time  versus  a 
standard. 

iv)  System  down-time.  A  comparison  of  system 
down-time  to  a  standard  with  narrative 
comments  for  reasons  there  is  a  variance. 

b)  System  Development  and  Maintenance 

i)  Application  performance  and  quality  audits. 
The  results  of  internal  audits  of  applica¬ 
tion  programs  highlighting  sut-standard 
performance . 

ii)  The  costs  attributed  to  project  or  applica¬ 
tion  maintenance  or  modification. 

iii)  Percentage  of  projects  completed  on  time. 

Also  the  percentage  of  maintenance  and  modi¬ 
fication  projects  that  were  completed  within 
estimated  completion  dates. 

c)  User  Relations 


i)  User  satisfaction  survey.  This  report 
should  quantitatively  rata  the  data 
processing  center's  customer  sari s fact icr. . 

4  *  Pe sc  urea  Allocation  Reports 

a)  Cost  justification  for  major  data  processing 
expenditures  that  have  to  be  approved  by  top 
management . 

b)  Major  proposals  for  new  systems  development. 
These  are  submitted  for  approval  and  priority 
assign ment . 

Additionally,  annual  reports  should  be  submitted  on  problems 
or  progress  in  the  following  areas: 

1 .  Bcdget  status 

2.  Major  applications  installed 

3.  Major  organizational  accomplishments 

4.  Contribution  of  the  data  processing  center  to  the 
organization's  goals. 

5.  Lcnq-range  plan  updates,  including  objectives,  plans 
and  budget  for  the  next  year 

Since  the  reports  typically  flow  from  the  lower  levels 
of  the  organization,  the  type  of  reports  submitted  tc  the 
data  center  manager  address  many  of  the  same  issues  of 
concern  to  the  commanding  Officer.  Although  the  focus 
remains  cn  problem  areas,  accountability,  and  corrective 
actions,  increased  attention  is  paid  to  planning  factors  and 
to  the  requirements  of  daily  activities.  The  following 
management  reports  should  be  submitted  to  the  data  center 
manager : 

1  •  Bcdget  Re  port  s 

These  reports  compare  actual  expenditure  to  expected 
expenditures  and  should  trigger  questions  to  func¬ 
tional  managers  whose  departments  show  unfavorable 
variances.  Generally,  purchase  requisitions  and 
personnel  contract  requests  are  submitted  to  this 
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level  in  the  organization  for  approval.  The  status 
of  facilities  and  service  contracts  are  reported  in 
■‘■he  tudget  reports.  Additionally,  the  current  starus 
and  problems  with  user  service  agreements  are 
reported  with  the  expected  impact  on  the  budget. 

•  Resource  Utilization  Reports 
a)  Operations 

i)  CPU  utilization  versus  availability. 
Separate  reports  indicate  rerun  time,  down¬ 
time,  preventive  and  remedial  maintenance 
time,  and  internal  data  processing  applica¬ 
tion  run  time.  User  CPU  utilization  trends 
for  remote  job  entry  (RJ2)  and  interactive 
applications  should  be  prepared  and 
percentage  cf  mainframe  CPU  utilization  for 
user  on-line  processing  should  be  reported. 

ii)  Library  status  report.  The  status  of  the 
tape  library  back-up  system,  tape  cleaning 
and  verification,  and  disk  compression 
should  be  reported  to  the  data  center 
manager.  Problems  in  this  critical  area  can 
cause  extensive  operational  difficulties. 

iii)  Cn-line  system  availability.  This  report  is 
of  lajor  concern  to  on- line  users.  The 
actual  system  availability  should  be 
compared  to  a  standard  and  reasons  for  lack 
of  availability  stated. 

iv)  Computer  hours  used  for  program  development 
and  testing. 

v)  Staffing  levels  by  shift  to  identify  sched¬ 
uling  problems  or  document  the  need  for 
increased  or  decreased  operations,  develop¬ 
ment,  and  maintenance  personnel.  If  the 
workload  can  not  be  accomodated  within  the 
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specified  standard  (i.e.,  daily  processing 
should  be  completed  by  the  conclusion  cf  the 
second  shift),  then  more  personnel,  improved 
methods,  cr  procedures  may  be  indicated. 
Likewise,  a  decrease  or  reassignment  of 
personnel  may  be  indicated  when  the  workload 
accomplished  exceeds  the  standard.  The 
report  itself  must  be  evaluated  in  terms  of 
its  marginal  value  to  its  marginal  ccst  to 
decide  if  this  performance  measure  contrib¬ 
utes  to  the  control  of  the  organization. 

vi)  Deviations  frcm  budgeted  operating  costs  or 
excessive  expenditures  on  supplies  should  be 
reported  as  an  exception  report  to  alert  the 
data  manager  to  not  only  budget  implications 
but  also  to  underlying  operational  problems. 

vii)  Data  entry  use  versus  capacity  available. 
Variances  in  .  data  entry  may  indicate  prob¬ 
lems  with  personnel,  hardware  peripherals, 
software  or  environmental  problems. 

viii)  Perpheral  device  utilization  in  terms  of 

time  and  capacity  should  be  reported  for 
planning  purposes.  The  percentage  of 

channel  capacity  useage  can  be  an  important 
performance  measure  in  determining  if  the 
system  is  operating  in  an  input/output 

limited  environment. 

b)  Systems  Development  and  Maintenance 

i)  A  backlog  of  development  and  maintenance 
work  request  showing  the  number,  type,  esti¬ 
mated  workload  (in  hours),  user,  status  and 
priority  of  requests. 

ii)  System  development  staff  time  worked  versus 
total  available  time.  This  can  be  a  measure 
of  relative  productivity. 
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iii)  System  development  staff  time  worked  by 
category  (new  system  development,  existing 
system  modification  or  maintenance)  in  hours 
and  as  a  percentage  of  staff  time  available. 

iv)  The  maintenance  and  modification  costs,  ir. 
terms  of  hardware  down-time  and  staff  time, 
should  be  reported  in  hours  and  trends  to 
identify  applications  or  project  candidates 
for  replacement. 

3 •  Performance  Control  Beports 
a)  Operations 

i)  A  summary  of  re-runs  by  major  application, 
showing  frequency,  machine  time  lost,  cost 
of  recovery  and  cause. 

ii)  A  summary  of  the  average  time  a  jet  stays  in 
queue  and  the  average  number  of  queues. 

iii)  A  summary  by  application  of  reports  deliv¬ 
ered  cn  time  compared  to  a  performance  stan¬ 
dard. 

iv)  Terminal  response  times  in  terms  of  averages 
and  means  to  detect  trends  that  may  result 
in  user  complaints. 

v)  A  summary  of  peripheral  hardware  failures  to 
indicate  reliability  problems,  plan  for 
contingencies  and  monitor  vendor  maintenance 
performance . 

vi)  Telecommunication  system  up-time  as  compared 
to  a  performance  standard. 

vii)  Transactions  processed  and  cost  per  trans¬ 
action. 

viii)  Status  of  training  (formal  and  on-the-jcb) 
as  compared  tc  a  standard. 

fc)  Systems  Development  and  Maintenance 
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i)  Percentage  of  projects  completed  on  time  ana 
completed  within  specified  costs  by  project 
category. 

ii)  Average  response  time  to  a  user’s  request 
with  the  period  noted  between  recispt  of 
request  and  start  of  actual  work. 

iii)  Average  turnaround  time  or  program  tests  and 
compilations  as  a  measure  of  operations 
support. 

iv)  Average  number  of  compilations  and  test  per 
program  to  indicate  whether  design  techni¬ 
ques  and  tools  are  being  used  effectively. 

In  addition  to  the  formal  reporting  struc¬ 
ture  the  data  processing  manager  should  hold 
weekly  staff  meetings  to  augment  the  infor¬ 
mation  received  in  the  formal  management 
reports. 

The  next  level  of  the  organisational  reporting  structure 
is  the  departmental  managers.  Typically,  these  individuals 
are  managers  of  the  data  processing  center's  operations, 
systems  development,  programming,  financial,  supply  and 
control  groups.  First  line  supervisors  such  as  these  that 
supervise  data  entry,  controls,  library  and  other  functions 
may  also  be  included.  These  "departmental  managers"  either 
generate  the  reports  to  higher  management  or  are  responsible 
for  the  production  of  these  reports.  This  level  of  manage¬ 
ment  is  concerned  with  the  following  categories  of  informa¬ 
tion  : 

1.  Individual  performance  evaluation 

2.  Allocation  of  personnel 

3.  Machine  performance  evaluation 

4.  Ensuring  information  validity 

The  department  managers  prepare  reports  for  upper  levels  of 
the  organization  and  therefore  receive  many  of  the  same 


80 


reports.  The  following  is  a  list  of  management  reports  used 
fcy  the  department  aa-nagers  that  are  unique  to  this  level  of 
the  organization  or  are  used  for  a  unique  function: 

1 .  Resource  Utilization  Re  ports 

a)  Operations 

i)  CPU  utilization  reports  used  for  initialting 
corrective  action.  Rescheduling  of  work  and 
allocation  of  channels  and  memory  can  be 
enhanced  by  actions  taken  resulting  from 
this  report . 

ii)  Remote  systems  reports  on  resources  at 

outlying  user  locations  can  be  used  for 
contingency  planning  and  job  rescheduling. 

fc)  Systems  Development  and  Maintenance 

i)  work  request  response  time  and  backlog. 

ii)  Personnel  leave  and  availability  schedules 
for  workload  planning. 

2.  Performance  Control  Reports 

a)  Operations 

i)  Computer  evaluation  reports  such  as  job 

accounting  logs,  software  monitors,  and 
hardware  monitor  reports. 

ii)  Reports  that  can  be  used  to  evaluate 

personnel  performance  such  as: 

•  Keystrokes 

•  Error-rates 

b)  System  Development  and  Maintenance 

i)  Project  status  reports  and  milestone  comple¬ 
tion  reports  can  be  used  for  evaluating 
development  and  maintenance  personnel. 

ii)  Documentation  status  reports  can  provide 

personnel  evaluation  information 

iii)  Personnel  evaluation  reports  provide  depart¬ 
ment  managers  with  a  direct  evaluation  of 
their  personnel. 
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Situational  reports  such  as  trouble  reports,  failure  reports 
cr  problem  reports  are  also  received  at  the  departmental 
level.  failure  reporting  and  analyisis  should  be  completed 
for  all  failures,  including  machines,  programs,  power 
supply,  facilities,  safety,  and  security.  For  instance. 
Naval  Supply  System  Command's  capacity  analysis  reporting 
system  [Bef.  122]  requires  reporting  of  machine  down-time, 
power  failures,  safety  and  security  violations  [Hef.  123], 

A  comprehensive  management  reporting  system  is  essential 
for  the  direction  and  control  of  the  data  processing  center. 
The  management  reporting  system  provides  essential  informa¬ 
tion  to  appropriate  levels  cf  management  for  planning, 
decisicn-making ,  and  control  of  data  processing. 

B.  CORHICTIVB  ACTIO* 

As  stated  earlier,  corrective  action  is  the  feedback 
mechanism  tc  remedy  an  "error  condition"  that  indicates  the 
organization  or  a  sub-group  of  the  organization  is  net  prog¬ 
ressing  sufficiently  toward  its  goal.  The  decision  to  take 
corrective  action  will  normally  be  made  at  a  level  cf  orga¬ 
nization  that  is  commensurate  with  the  responsibility  for 
that  performance  and  how  strategically  important  that 
performance  is  to  the  organizational  goal.  The  process  in 
deciding  what,  if  anything,  should  be  dene  abcut  the  vari¬ 
ance  in  performance  involves  [Hef.  124], 

1.  Diagnosis  of  the  problem  with  regard  to  its  nature 
and  causes  and  a  statement  of  the  requirements  of  a 
satisfactory  solution.  The  constraints  within  which 
the  corrective  action  must  be  made  must  also  be  iden¬ 
tified. 

2.  Determination  of  alternative  solutions  "will  range 
fzem  doing  nothing  to  finding  a  way  cut  of  the  diffi¬ 
culty,  removing  the  difficulty  or  even  modifying  the 
objective"  [Hef.  125]. 
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Analysis  and  comparison  cf  alternatives  to  determine 
the  advantages  and  disadvantages  of  each  solution. 

4.  Selection  of  the  corrective  action  alternative  tc  b® 
followed  with  identification  of  all  significant 
consequences  cf  that  choice. 

As  discussed  in  Chapter  3,  the  timing  of  th®  corrective 
acticn  is  an  important  factor  in  how  the  system  performance 
will  react.  Premature  response  or  over- reaction  can  cause  an 
uncontrolled  oscillation  in  performance  if  the  persons 
responsible  for  ordering  corrective  actions  are  not  familiar 
with  the  sensitivity  of  a  particular  performance  parameter 
to  change  and  they  dc  not  knew  the  effect  a  change  in  this 
performance  measure  may  have  on  other  performance  parame¬ 
ters.  If  a  manager  reacts  too  soon  to  a  performance  meas¬ 
urement,  the  condition  that  gave  an  out  of  control 
indication  may  be  worsened.  For  instance,  if  CPO  idle  time 
is  above  standards,  the  data  processor  manager  may  be 
inclined  tc  run  more  jobs  when  in  fact  the  job  mix  of 
input/output  intensive  jobs  is  the  reason  the  CPU  utiliza¬ 
tion  is  down.  If  the  data  processing  manager  waits  too  leng 
tc  take  corrective  action,  the  condition  may  worsen  to  the 
extent  that  primary  services  to  the  customer  are  terminated. 
An  example  cf  not  taking  corrective  action  soon  enough  might 
be  where  a  data  entry  clerk  has  a  problem  entering  an  inven¬ 
tory  receipt  and  instead  of  the  data  entry  supervisor 
calling  in  a  trouble  report,  the  data  clerk  continues  to 
enter  the  data.  Each  time  the  data  entry  clerk  keys  the 
enter  command  the  receipt  information  is  queued  and  when  the 
transaction  is  finally  processed,  multiple  receipts  of  xh® 
same  document  are  recorded.  A  solution  to  the  over-reaction 
problem  recommended  by  Webber  [Ref.  126]  is  tc  monitor 
sensitive  performance  parameters  on  a  continuous  basis  and 
respond  %ith  small  corrections.  This  action,  if  appropriate 
to  the  specific  performance  parameter,  should  prevent  ccstly 
premature  response  or  over- reaction  to  a  variance. 
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Equally  important  as  the  decision  of  what,  if  any, 
action  should  be  done  is  the  question  of  who  should  actually 
make  the  correction.  The  level  cf  management  that  makes  the 
decision  to  take  corrective  action  must  consider  the 
following  things  in  assigning  the  task: 

1.  Responsibility;  Is  the  person (s)  assigned  to  take  the 
corrective  action  responsible  for  that  particular 
performance  standard?  If  there  is  joint  responsi¬ 
bility,  then  all  responsible  parties  should  be 
advised. 

2.  authority;  Dees  the  person  tasked  with  making  the 
corrective  action  have  the  line  authority  to  make  it 
happen? 

3.  System  impact;  Will  the  corrective  action  affect 
ether  performance  parameters?  If  so,  persons  respon¬ 
sible  for  those  performance  parameters  should  be 
consulted. 

4.  Agreement;  The  corrective  action  should  receive 
support  from  not  only  the  decision-maker,  but  also 
these  persons  responsible  for  making  the  corrections. 

There  is  no  magic  formula  of  how  many  variances  constitute  a 
performance  problem  or  how  long  a  manager  should  wait  to 
determine  if  there  is  a  problem.  These  are  management  deci¬ 
sions  that  must  be  guided  by  inputs  from  appropriate  levels 
cf  the  organization  for  each  performance  area  and  an  appre¬ 
ciation  of  the  entire  system  environment. 


V.  EVALUATION  GUIDE 


1.  INTRODUCTION 

There  are  many  types  of  computing  facilities  within  the 
Navy,  and  each  one  will  have  its  own  unique  characteristics 
as  well  as  vast  operational  differences.  A  NARDAC  for 
example,  with  the  computing  facility  being  the  Command 
itself,  will  function  quite  differently  than  a  Data 
Processing  Center  at  a  Naval  supply  center.  At  a  NARDAC, 
Command  and  Data  Processing  Center  goals  and  objectives 
would  be  one  in  the  same  as  would  the  roles  of  Commanding 
Officer  and  Data  Processing  Officer.  A  Data  Processing 
Department  at  a  Naval  Supply  Center,  however,  would  have  a 
hierarchical  structure  with  broader  Command  goals  and  objec¬ 
tives  which  should  be  reflected  in  the  subordinate  depart¬ 
ment's  more  specific  goals  and  objectives.  while  many 
fundamental  similarities  remain  among  computing  facilities 
and  their  inherent  requirements  for  control  systems,  the 
unique  mission  and  operational  requirements  imbedded  in  each 
organization  cause  any  attempt  to  generate  an  evaluation 
guide  spanning  these  requirements  to  be  necessarily  general 
in  nature.  » 

This  evaluation  guide  is  focused  on  management  control 
system  issues  as  described  in  the  previous  chapters  of  this 
thesis.  However,  this  guide  is  by  no  means  intended  to  be  a 
comprehensive  document  covering  all  aspects  of  a  computing 
facility’s  operation  in  the  detail  an  Insector  General  or 
audit  team  may  desire.  The  intended  purpose  of  this  evalua¬ 
tion  guide  is  to  aid  a  data  processing  manager  or  prospec¬ 
tive  data  processing  manager  in  assessing  the  effectiveness 
and  apprcpriatness  of  the  management  control  system  for  a 
typical  Navy  computing  facility. 
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This  evaluation  guide  was  developed  within  the  scope  of 
the  issues  and  theories  discussed  in  this  thesis.  Use  of 
this  guide  should  be  tempered  with  a  ■'•big  picture"  assess¬ 
ment  of  the  computing  facility  being  evaluated  in  terms  of 
technology,  organizational  structure,  and  stated  mission. 

The  guide  itself  is  conceptual  in  nature  with  many  qual¬ 
itative  terms  included  that  must  be  defined  in  a  qualitative 
sense  by  the  user.  additionally,  many  of  the  questions  that 
are  asked  contain  some  elements  that  may  appear  to  be  mutu¬ 
ally  exclusive.  Owing  to  the  diverse  nature  of  the  types  of 
computing  facilities  that  this  document  could  be  used  for, 
the  threat  is  to  provoke  questions  that  cover  a  broad  range 
of  issues.  These  issues  can  vary  in  their  applicability 
from  one  facility  tc  another  and  it  is  incumbent  on  the  user 
to  determine  the  applicability  of  each  question. 

Another  key  element  in  the  proper  use  of  this  document 
is  tc  develop  a  feel  for  the  underlying  charact erist ics  of 
the  organization  being  evaluated  in  terms  of  the  management 
theories  that  influence  management  controls  as  presented  in 
this  study.  some  cf  the  major  influences  include  the 
following: 

1.  Ouchi's  framework  for  management  control:  The  ability 
tc  measure  either  output,  processes  or  neither  will 
shape  the  control  mechanisms  in  three  fundamental 
frameworks  called  markets,  bureaucracies,  or  clans. 

2.  Nolan’s  stages  of  technological  growth:  The  stages 

which  all  data  processing  organizations  go  through 
are  defined  as  initiation,  contagion,  integration, 
and  control.  Each  stage  will  require  a  different  form 
of  management  control. 

3.  Thompson's  types  of  task  interdependence:  Three  defi- 
nitiens  of  task  interdependence  which  will  influence 
organizational  structure  were  defined  as  pooled, 
sequential,  or  reciprocal. 


Tempered  with  a  fundamental  grasp  of  the  organization's 
positions  with  respect  to  the  themes  and  issues  presented, 
the  user  is  tasked  tc  evaluate  the  management  control  system 
effectiveness  in  their  own  quantitative  terms.  The  questions 
are  intended  to  stimulate  interest  and  investigation  and 
evaluation  of  the  areas  covered. 

EVALUATION  GUIDE 

E.  ORGANIZATION 

1.  Is  there  a  current  chart  of  the  Command's  organiza¬ 
tional  structure  down  to  the  Data  Processing  Center 
level? 

2.  Is  there  a  current  chart  of  the  Data  Processing 
Center's  organizational  structure? 

3.  Is  there  a  listing  of  key  management  personnel  in  the 
Command's  chain-of -command  from  the  Commanding 
Officer  down  through  the  Data  Processing  Center 
branch  level? 

4.  Is  organizational  structure  designed  so  there  is  no 
overlapping  of  functions,  responsibility,  or  duplica¬ 
tion  of  effort? 

5.  Is  the  existing  centralization,  or  mixture  of  both 
satisfactory? 

6.  Are  the  functions  ,  responsibilities,  authority,  and 
relationships  of  each  significant  position  in  the 
organization  defined  in  writing? 

7.  Is  there  satisfactory  rapport  between  management, 
staff  and  users? 

8.  Is  the  organizational  structure  in  harmony  with  the 
objectives  of  the  Command  and  the  Data  Processing 
Center? 


9.  is  authority  sc  delegated  as  to  permit  decisions  to 
te  made  at  the  lowest  feasible  levels  of  management? 

10.  Dees  the  organizational  structure  provide  for  unity 
of  command  --  each  person  reporting  to  no  more  than 
one  superior? 

C.  HISSIOH 

1.  Is  the  mission  of  the  Command  clearly  stated? 

2.  Is  the  mission  of  the  Data  Processing  Center  clearly 
stated? 

£.  GC1LS  ADD  OBJECTIVES 

1.  Are  command  gcals  and  objectives  set  down  in  writing? 

2.  Are  Data  Processing  Center  goals  and  objectives  set 
down  in  writing? 

3.  Is  there  consistency  and  continuity  between  Command 
gcals  and  objectives  and  Data  Processing  Center  gcals 
and  objectives? 

4.  Are  goals  and  objectives  measurable,  attainable, 
comprehensive ,  and  relevant  to  the  Data  Processing 
Center's  needs? 

5.  Are  goals  and  objectives  reappraised  periodically  to 
ensure  uniformity  and  congruency  among  organizational 
components? 

E.  0EE8 ATICHS 

1.  Are  decisions  irade  at  the  lowest  feasible  level? 

2.  Is  there  a  methodology  to  review  tasking  (or  priori¬ 
tization)  versus  resources? 

3.  »hat  methods  are  used  for  cost  allocation  and  meas¬ 
urement?  Dc  they  encourage  effective  use  of  the 
computer  resource? 


<4. 
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.  How  are  job  priorities  assigned?  Is  the  priority 
linked  to  the  job  pricing  scheme? 

5.  Has  an  approval  system  been  implemented  that: 

a)  Has  approval  levels  commensurate  with  the  signifi¬ 
cance  of  the  project? 

b)  Reviews  validity  of  the  job? 

c)  Determines  job  priority? 

d)  provides  coordination  for  jobs  that  spar,  several 
departments? 

6.  Is  there  a  conflict  between  management  job  prioriti¬ 
zation  and  user  job  prioritization  (  eg.  user  assigns 
a  high  priority  to  a  long  job  but  the  system  is 
running  a  "shortest  job  next"  queueing  algorithm  )? 
Is  there  a  procedure  to  resolve  these  conflicts? 

7.  Are  there  procedures  to  track  the  input  and  output  of 
all  jobs? 

8.  Are  precomputer  and  postcomputer  activities  scheduled 
and  included  in  the  turnaround  time  performance 
crit  eria? 

9.  Is  there  a  method  to  locate  jobs  that  are  delayed, 
and  can  requests  about  job  status  be  answered  easily? 

10.  Is  there  a  standard  methodology  to  prevent,  detect 
and  follow-up  cn  processing  errors? 

11.  Are  the  folowing  items  considered  in  the  budget  prep¬ 
aration: 

a)  Oser  demand  and  resource  supply  for  computing 
services? 

b)  Effect  on  "sales"  of  service,  pricing,  quality  and 
responsiveness? 

c)  The  effect  cf  commercial  competition? 

d)  Hew  to  generate  new  users? 

12.  Dees  the  scheduling  branch  or  section  know  where  jobs 
are,  and  the  status  of  all  jobs  on  a  continuing 
basis? 
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13.  Are  there  differences  in  scheduling  techniques  user, 
during  prime  time  and  non-prime  time  shifts?  Is  a 
shift  differential  applied  to  the  job  pricing  scheme? 

14.  Dees  management  receive  periodic  status  reports  on 
work  scheduled,  being  processed,  and  completed? 

15.  Are  there  backup  procedures  for  disk  and  tape  files? 
Hew  are  files  tacked  up? 

16.  Dees  the  budget  provide  for: 

a)  logical  standards? 

b)  comparison  between  budgeted  and  actual  costs  for 
work  planned  and  accomplished? 

c)  exclusion  of  those  items  over  which  management  has 
no  control? 

d)  differentiation  between  budget  goals  and  organiza¬ 
tional  goals? 

e)  periodic  examination  of  standards? 

f)  participation  in  setting  budgets  by  those  who  must 
live  with  them? 

17.  is  a  chargeout  or  chargeback  system  required  to  make 
users  aware  of  costs  or  to  control  costs  and  work¬ 
load? 

18.  Are  reimbursable  charges  correctly  and  accurately 
assessed  to  the  appropriate  customer? 

19.  Are  rerun  and  downtime  credits  correctly  incorporated 
into  the  tilling  system? 

20.  Is  provision  made  for  prompt  expediting  and  feedback 
of  information  to  management  on  variances  between 
established  budgets,  schedules  and  actual  accomplish¬ 
ments? 

21.  Dees  the  pricing  scheme  measure  and  provide  a  basis 
fer  controlling  user  consumption  of  resources? 

22.  Is  the  budget  process  used  as  a  mechanism  to  plan  the 
provision  of  computing  resources  and  determine  their 
allocation? 
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23,  If  a  charging  system  is  used,  are  the  following 
function s/characteristics  included: 

a)  Provide  management  information  for  resource 

control  and  decision-making? 

b)  Provide  a  means  of  allocating  resources  amcng 
users? 

c)  Encourage  users  tc  employ  computing  resources 
effectively  and  efficiently? 

d)  Promote  effective  and  efficient  provision  of 
services  by  the  computer  facility? 

e)  Permit  decentralization  of  control  over  resource 
allocation  decisions? 

f)  Tailored  tc  the  objectives  it  is  to  serve? 

24,  Dees  the  management  control  system  control  user  job 
arrival  and  internal  job  sequencing? 

25.  Are  all  operators  familiar  with  Data  Processing 
Center  responsibilities  cited  in  maintenance 
contracts? 

26.  Dees  the  management  control  system  monitor  jot  prior¬ 
itization  in  terms  of  hardware  performance,  software 
performance,  cr  pricing? 

I.  P1BPCBB AHCE  BEASOBEBEHT 

1 .  Is  there  an  individual  or  individuals  within  the  Data 
Processing  Center  responsible  for  monitoring  system 
performance? 

2.  Are  there  procedures  to  track  and  report  resource 
utilization  and  system  performance? 

3.  To  whom  and  at  what  freguency  do  you  report  system 
performance  measurements  and  resource  capacity? 

4.  Are  significant  performance  attributes  measured, 
including  capacities  of  resources  for  workloads, 
effectiveness  in  serving  users,  and  efficiency  in 
utilizing  resources? 
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5.  Is  there  a  management  system  to  review  tasking  {  or 
prioritizaton  )  versus  resources? 

6.  Is  there  a  way  to  determine  which  applications  use 
the  most  computer  resources? 

7.  can  performance  measures  provide  feedback  to  eval¬ 
uate: 

a)  validity  of  standards? 

b)  success  or  failure  tc  meet  standards? 

8.  Are  performance  attributes  based  upon  a  balanced  set 
of  criteria  sc  as  not  to  sacrifice  one  factor  for 
another? 

9.  Are  the  following  performance  measurement  tccls 
installed  and  utilized: 

a)  operating  system  accounting  packages? 
t)  hardware  monitors? 

c)  software  monitors? 

d)  imbedded  system  monitors? 

10.  Are  there  reviews  to  assess  which  performance  attri¬ 
butes  are  feasible  to  precisely  and  accurately 
measure? 

11.  Dees  the  methodology  for  choosing  performance  meas¬ 
urements  include  the  following: 

a)  Identify  the  purpose  for  the  measurement? 

b)  identify  tie  relevant  feasible  attributes  tc  be 
measur  ed? 

c)  Evaluate  the  measurements  in  terms  of  validity, 
reliability,  and  meaningfulness? 

d)  Evaluate  the  cost  and  relevance  cf  the  measurement 
system? 

12.  Are  measures  cf  performance  free  from  factors  that 
are  outside  the  control  cf  the  responsibility  center? 
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1.  Are  measurable,  quantifiable  standards  established  in 
terms  of  cost,  quality,  and  schedules? 

2.  Axe  the  standards  based  upon  a  balanced  set  of 
criteria  so  as  not  to  sacrifice  any  one  factor  (  eg. 
quality,  cost,  or  schedule  )  for  another? 

3.  Dees  the  control  system  provide  feedback  to  manage¬ 
ment  to  evalauate: 

a)  The  validity  of  standards? 

b)  The  success  or  failure  at  meeting  standards? 

4.  Is  there  provision  fer  establishing  and  disseminating 
new  standards  cf  performance  when  old  ones  are  found 
tc  te  inadequate  or  ineffective? 

5.  Are  performance  standards  precise  and  communicated  to 
the  appropriate  level  cf  management? 

6.  Are  standards  for  each  organizational  group  reviewed 
to  ensure  that  there  is  no  conflict  between  groups? 

7.  Are  standards  reviewed  for  validity  and  is  the 
performance  level  required  by  the  standard  consistent 
with  the  progress  towards  the  goals  and  objectives? 

8.  Are  standards  constructed  in  such  a  way  that  they  not 
only  provide  empirical  data  but  also  facilitate  anal¬ 
ysis  in  terms  cf  patterns,  trends,  and  indicators? 

B.  P IBFOBH AHCE  BVALOATIOX 

1.  Is  downtime,  rerun  times,  hardware/software  problems 
recorded  and  reported  for  management  action? 

2.  Does  the  manager  have  records,  reports,  and  statis¬ 
tics  needed  tc  translate  organizational  objectives 
irtc  terms  of  performance  and  corrective  action? 

3.  Are  provisions  made  for  periodic  spctchecks  of  work 
in  process  or  completed  work  to  ensure  conformity  to 
established  standards? 
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4.  is  Data  Processing  Carter  service  to  users  within 
performance  standards  for  scheduled  jobs,  unscheduled 
jobs,  and  on-line  jobs? 

5.  Are  there  performance  standards  for  each  work  area? 

6.  Are  internal  audits  conducted  on  data  processing 
management  and  operational  functions  to  include  the 
following  areas: 

a)  Adherence  to  organizaitons' s  policies,  rules,  and 
regula  tion  s? 

b)  Efficient  use  of  resources? 

c)  Physical  security  of  the  data  processing  center? 

d)  Documentation  of  standards  and  procedures? 

e)  Long-range  resource  planning  (facilities,  equip¬ 
ment,  etc.)? 

7.  Dees  the  management  control  system  provide  a  struc¬ 
ture  for  continous  audit  trails? 

8.  Are  persons  responsible  for  meeting. performance  stan¬ 
dards  involved  in: 

a)  Setting  of  the  standards? 

b)  Collection,  analysis,  interpretation,  and  evalua¬ 
tion  of  the  comparison  data? 

c)  Deciding  what  corrective  action  should  be  taken? 

9.  Do  management  reports  have  the  following  characteris¬ 
tics  : 

a)  Measure  and  evaluate  all  functions  that  contribute 
tc  attainment  of  the  organizational  goals? 

b)  Tailored  to  specific  functions  and  express 
performance  in  terms  appropriate  to  that  function? 

c)  Contrast  related  measures  of  performance  in  such  a 
manner  that  may  indicate  cause  and  effect  rela¬ 
tion  ships  ? 

d)  Stated  clearly  and  concisely? 

e)  Measure  performance  against  a  predetermined  stan¬ 
dard? 
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f)  Bread  enough  timeframe  to  allow  historical  back¬ 
ground  on  which  tc  base  judgements  of  the  perform- 
a  nee  ? 

g)  address  resource  utilization  versus  available 
capacity? 

h)  Prepared  in  an  appropriate  periodicity  to  allow 
timely  corrective  action? 

i)  Provide  performance  information  to  draw  inferences 
cn  potential  problems? 

j)  Facilitate  trend  analysis  for  organizational  plan¬ 
ning  ? 

I.  PUNNING 

1.  Dees  the  Data  Processing  Center  participate  in  the 
development  of  user*  s  functioonal  requirements? 

2.  Is  there  a  framework  for  integrating  new  application 
requests  into  the  data  processing  center  operations? 

3.  Are  economic  analysis  techniques  utilized  in  evalu¬ 
ating  new  applications  and  projects? 

4.  Hew  are  projected  workloads  determined? 

5.  Are  personnel  requirements  projected  in  terms  of 
future  workload  requirements? 

6.  Are  budget  estimates  based  on  realistic,  logical, 
supportable,  and  mathematically  correct  premises  and 
standards? 

7.  Dees  long-range  planning  incorporate: 

a)  organizational  changes? 

b)  technological  changes? 

c)  cost/benefit  analysis? 

d)  workload  projections? 

8.  Are  there  contingency  plans  for  the  various  types  of 
processing  disruptions  which  require  operating  with 
fewer  resources  or  at  another  site? 
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9.  Are  personnel  trained  in  contingency  procedures?  Are 
there  periodic  drills? 

10.  Dees  planning  include: 

a)  user  participation? 

b)  executive/steering  committees? 

c)  cost/benefit  analysis? 

J.  TBAIBISG 

1.  Dees  employee  training  include  instructions  on  the 

responsibilities, requirements,  and  functions  of  their 
position? 

2.  Eces  employee  training  include  instructions  on  the 

organization  * s  objectives,  standards,  policies, 
procedures,  and  means  of  measuring  performance? 

3.  Are  there  on-the-job  training  programs  designed  to 

increase  techrical  proficiency  and  professional 
competence? 

4.  Are  cross  training  programs  available  to  broaden 

career  paths  and  provide  back-up  skills  in  key  posi¬ 
tions? 

5.  Are  employees  encouraged  to  develop  professional  and 
technical  competence  through  off-duty  studies? 

6.  Is  there  a  current  and  active  annual  training  plan? 

K.  P1ESCNHEL 

1.  By  what  means  are  data  processing  center  personnel 
evaluated,  paid,  and  promoted? 

2.  Are  there  any  present  or  projected  deficiencies  or 
vacancies  in  any  key  positions? 

3.  Is  there  an  upward  employment  path  for  employees  that 
includes  training  and  participation  in  the  formula¬ 
tion  of  management  policies  and  procedures? 
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4.  Are  personnel  management  goals  reflected  in  the 
Command  and  Cata  Processing  Center  goals  and  objec¬ 
tives? 

5.  Have  efforts  teen  identified  to  attract  and  keep 
quality  and  experienced  personnel? 

6.  Are  personnel  records  maintained  to  ensure  that  all 
appropriate  actions  are  documented? 

7.  Do  position  descriptions  contain  the  current  proce- 
dcres  and  adequate  job  performance  standards? 

8.  Do  all  position  descriptions,  procedures  and  policies 
reflect  the  latest  performance  objectives  and 
requirements  cf  the  organization? 

9.  Are  periodic  position  reviews  performed  on  schedule? 

10.  Are  periodic  performance/evaluation  reviews  conducted 
on  schedule? 

11.  Are  supervisors  performing  prescribed  supervisory 
responsibilities?  Are  there  clear  cut  delegations  of 
authority? 

12.  Have  employees  received  written  elements  and  perform¬ 
ance  standards  for  their  positions? 

1.  USER  IHTERPACE 

1.  Are  the  needs  of  users  reviewed  and  are  their  opin¬ 
ions  solicited  as  to  the  quality  of  services  or  prod¬ 
ucts  fornished? 

2.  Is  there  a  procedure  to  inform  the  user  community  of 
system  problems,  expected  downtime,  and  expected 
impact  on  user  services? 

3.  Are  regularly  scheduled  meetings  held  with  the  user 
community? 

4.  is  provision  made  for  all  complaints  and  recommenda¬ 
tions  from  users  to  be  recorded  upon  receipt,  evalu¬ 
ated,  acted  upcn,  and  answered? 
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5.  Does  the  Data  Processing  Center  participate  in  the 
development  of  user  functional  requirements? 

6.  Is  there  an  active  data  center  steering  committee 
whose  duties  include: 

a)  Coordination  of  data  processing  center  and  user 
activities  ? 

t)  Resolution  cf  scheduling  difficulties? 

c)  Data  processing  center's  awareness  of  upcoming 
resource  demands? 

d)  User  awareness  of  application  processing  problems 
and  inefficiencies? 

e)  Examination  of  alternative  processing  approaches? 

7.  Is  there  a  user/data  center  handbook? 

8.  Is  there  a  periodic  review  to  verify  the  validity  of 
user  service  agreements? 

9.  Are  user  service  profile  trends  maintained? 

10.  If  users  have  authority  to  purchase  and  operate 
commercially  available  software  and  hardware,  what 
are  the  data  processing  center's  maintenance  respon¬ 
sibilities? 

11.  Is  the  user  tc  required  to  use  life-cycle  management 
techniques  in  acquisition  of  software  and  hardware? 

12.  Is  off-site  hardware  and  software  compatible  with  the 
data  processing  center's  systems? 

13.  Are  user  and  data  processing  center  responsibilities 
defined  and  documented  to  prevent  and  reconcile  areas 
of  conflict? 

14.  is  the  data  processing  center  sensitive  to  the  effect 
that  the  cost  cf  service  will  have  on  user  demand? 


71.  CONCIOSIONS 


«.  SQBMiBT 

1  management  control  system  is  the  set  of  processes 
through  which  organizations  ensure  that  actual  activities 
conform  to  planned  activities  [Hef.  127].  The  unique  nature 
of  the  computing  process,  including  hardware  and  software 
technology,  user  sophistication,  and  organizational  struc¬ 
ture,  has  introduced  some  specific  considerations  that  need 
to  be  addressed  when  designing  cr  evaluating  the  management 
control  system  at  a  Bavy  computing  facility.  The  management 
control  system  must  te  able  tc  respond  to  change  and,  it 
fact,  evolve  itself  with  ongoing  changes  in  computer  tech¬ 
nology,  software  developments,  and  user  demands  for  new 
applications. 

The  management  control  system  of  a  computer  facility 
involves  significantly  more  than  a  daily  measure  of  output 
per  unit  of  input.  Issues  that  influence  and  in  some  cases 
even  dictate  the  type  or  structure  of  the  management  control 
system  required  by  an  organization  are  often  long-termed  and 
very  broad  in  scope.  Questions  must  ba  asked  regarding:  the 
stage  of  technological  growth  cf  the  organization,  the  capa¬ 
bility  cf  the  organization  to  measure  either  outputs  or 
processes,  the  amount  of  task  interdependence,  the  organiza¬ 
tional  structure  and  related  mission,  and  a  sense  for  the 
organization’s  planning  and  committment  to  meeting  its 
objectives. 

Non-financial  controls  are  very  important  to  the  opera¬ 
tional  issues  involved  in  a  computer  facility  management 
control  system,  as  are  the  traditional  components  of  a 
financial  architecture,  a  financial  control  process,  and  an 


audit  function.  The  manage ment  control  system  must  include 
methods  to  provide  for  effective  and  efficient  resource 
utilization  and  also  a  structure  for  auditing. The  control 
system  provides  status  of  the  organization's  operations  so 
that  activities  may  te  controlled  in  order  to  meet  objec¬ 
tives  and  performance  standards.  Additionally,  procedures 
and  technology  can  be  modified  to  permit  setting  of  higher 
standards. 

A  management  control  system  was  described  earlier  as  a 
critical  network  which  integrates  the  organization's  opera¬ 
tions.  It  builds  on  the  output  of  the  planning  process  to 
develop  projects,  hardware  and  software  improvements,  facil¬ 
ities  enhancements,  and  personnel  reguirements.  The  manage¬ 
ment  control  system  is  the  ccmmon  denominator  in  evaluating 
the  organization's  progress  towards  achieving  its  goals  and 
objectives. 

This  study  was  conducted  using  traditional  literature 
search  techniques  as  well  as  visits  to  Navy  Regional  Data 
Automation  Center,  San  Francisco,  Naval  Supply  Center, 
Charlestcn,  S.C.,  and  Naval  Supply  Systems  Command.  The 
issues  presented  in  this  study  represent  the  authors* 
efforts  to  provide  seme  conceptual  frameworks  as  well  as 
practical  evaluation  criteria  to  aid  a  manager  in  assessing 
the  management  controls  in  a  typical  Navy  computing 
facility.  The  concepts  and  evaluation  guide  presented  herein 
will  have  to  be  tailored  to  the  specific  facility  being 
evaluated. 

I.  BfCOBHllDATXOlS 

One  cf  the  first  and  most  obvious  discoveries  made  by 
the  authors  was  the  fact  that  there  are  vast  differences 
betweet  many  of  the  Navy's  computing  facilities,  while  many 
similarities  are  alsc  present.  For  this  reason,  the  study 


and  the  evaluation  guide  are  intended  to  provide  seme 
discussion  and  insight  to  the  many  possible  issues  that 
impact  on  a  manager  in  developing  or  evaluating  the  manage¬ 
ment  ccntrol  system  at  any  particular  Navy  computing 
facility. 

While  many  of  the  issues  are  discussed  in  great  detail, 
some  of  the  topics  sectioned  would  be  beyond  the  scope  of 
this  study  to  provide  adequate  guidance  by  itself.  Economic 
analysis,  for  instance,  should  be  thoroughly  researched 
before  attempting  to  apply  the  principles  involved. 

The  test  approach  to  using  this  paper  and  its  included 
evaluation  guide  would  be  to  gain  a  basic  understanding  of 
the  organization  with  respect  to  the  issues  presented  in  the 
text  of  the  study.  Once  that  is  accomplished,  the  evalua¬ 
tion  guide  can  be  used  to  conduct  a  step-by-step  analysis 
through  answering  the  questions  provided. 
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